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Preface 



The workplace is changing drastically these days. As a consequence of 
the Information and Communication Technology (ICT) revolution, new 
economic activities emerge, the production process changes, people use 
different communication tools, and organizational stmctures are adjusted. 
All these changes relate to the heart of business and economics, and there is 
no doubt that they will also influence education in these areas. Of course 
ICT provides new technologies to facilitate learning, but a changing 
workplace also requires a renewed focus within the curriculum of economics 
and business education. 

If ICT is leading to profound change in the workplace, is innovation then 
only a matter of introducing more technology in education? Unfortunately, 
this is not necessarily true. The translation of changes in the workplace into 
an improved curriculum requires serious analysis of the essence of the 
changes at the work place, and the way technology may enable student 
learning. 

For example, relevant knowledge is changing faster and faster. Does this 
mean that we have to adopt the curriculum faster and faster? Perhaps not, as 
students will have a labor market career of 30 or 40 years. Focusing on 
today’s knowledge - even if it is very up-to-date - loses more and more 
value if the life cycle of knowledge becomes shorter. Increased speed of 
change also implies a decrease in the value of knowing all these things. 
Skills that are timeless will therefore increase in their relative value. More 
distance between what is taught at universities and used in actual work 
practices could be a rational response. Perhaps these skills might help 
students adopt new knowledge in the workplace. 

It is often argued that students should be trained in using technology to 
avoid a gap between education and labor market. Many economists have 
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shown that people working with computers earn more than people who don’t 
use a computer! Does this mean that computer skills are rewarded? Perhaps 
not. Computers take over many tasks we had to perform previously, and to 
be honest, even we were able to learn Word, PowerPoint, and Excel without 
much effort. While the computer facilitates our communication, 
administration and formal analyses, we can spend more time on all those 
things a computer is still not good at: talking with people, creating new 
ideas, being friendly to customers etc. So perhaps we could trust that 
students will pick up computer skills later and focus more on all these “soft 
skiHs.” 

Although the relationships between a changing workplace and the 
curriculum are not always as linear as one might think or hope, it is evident 
that change is taking place and some skills are becoming more valuable than 
others. Does this mean that we should look for a renewed curriculum that 
takes care of all the things we learned ten years ago plus all these new skills? 
It is veiy likely the answer is no! We could regard people responsible for the 
curriculum as engineers. If they claim to be able to create a new machine 
that is able to meet new demands without diminishing attention for the old 
skills, these innovations should of course be implemented. But there is no 
reason to wait with these innovations until the labor market is changed. 
Producing more of a certain skill without offering other skills is always a 
gain. A changing working place requires a reevaluation of skills and, without 
doubt, means that while some skills increase in value, others become less 
important. As long as learning resources are scarce, choices have to be made. 

Innovation is an important concept in economic theory and widely 
regarded as a major force behind economic growth and welfare. What’s true 
for society as a whole will also hold for different kinds of activities within 
society, of which business and economics education are two. This strong 
belief that investments in educational innovations in this field are 
worthwhile drives the people who are contributing to the EDINEB network. 
EDINEB stands for “Educational Innovation in Economics and Business” 
and is a network organization that aims to encourage and stimulate 
innovation in business and economics education (visit the EDINEB website: 
http://www.edineb.com or http://www.edineb.net). This book offers many 
contributions that deal with the struggle about how to implement changes at 
the workplace into a renewed curriculum. It is the fifth volume in the 
EDINEB book series. 

Like all products educational innovation in business and economics has a 
product life cycle. Within six years about 400 papers have been presented, 
most of which provided new and creative solutions to improve the way we 
teach, the way we organize the curriculum, the technology we use, and the 
cooperation with the organizations that recruit our students. The number of 



XVII 



papers has grown from 65 for the first conference in 1993 to 120 for the fifth 
conference in 1998. It is evident that EDINEB has established a position in 
the field of innovative education in business and economics. 

As is true for any product, innovation has to start with creative thought. 
EDINEB has brought together these creative ideas. After six years in the 
existence of EDINEB, two new challenges emerge. Both challenges seem to 
point in the same direction. The first challenge is to convince people of the 
need for change. Many chapters in this and previous volumes mention the 
resistance to change among teachers and administrators. “Nobody l ik es 
change, except wet babies” has become an important metaphor in the 
EDINEB discussion. But many experienced parents know that even wet 
babies prefer to continue playing. In the world of education, administrators 
and teachers sense that changes in the outside world are affecting the world 
of education. But it is one thing to notice change is needed, it is quite another 
to develop appropriate answers to different needs. EDINEB provides a 
platform for exchange of ideas and knowledge to work out new approaches 
for changing needs. 

The second challenge is about evaluation and educational measurement 
to facilitate change. After six years of sharing creative approaches to 
innovation, it is about time to evaluate how far EDINEB has come. It looks 
like the EDINEB network planted many seeds in the fields of business and 
economics education. Today there are signals that these seeds have turned 
into crops ready for harvesting. Over the past six years, many contributors 
have presented their approaches to educational innovation. But it looks like 
we lacked sufficient time to develop a research agenda that addresses the 
issue what the effects of innovations are. Further progress in educational 
innovation in business and economics requires that we learn about what 
works and what is less effective. After six years of innovation the product 
life cycle requires that we turn from pure creativity into developing a 
research agenda resulting in more insights about the innovations that work. 
Educational innovations are always bom in practice and therefore research 
will always be hampered by practicalities, but the only way in which we can 
discover the effectiveness of new ways of learning still remains with 
conducting educational research. From an economic point of view, this 
measurement should also include both the costs and the benefits. 

The contributions in this volume reflect the central theme of this book: 
business education for the changing workplace. Part I contains contributions 
about what education can learn from new developments in business: learning 
and the changing work place. Paid II - technology and innovation - explicitly 
puts forward the role of technology in learning. Paid III contains papers 
about innovative learning methods. 
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To complement these thematic parts two smaller sections have been 
added which are especially interesting from the measurement point of view. 
Part IV is about assessment, which is a promising way to bring together as 
much as possible what we measure with the goals of education in business 
and economics. Part V focuses on cognition and learning and will contribute 
to our knowledge about the way in which students acquire knowledge and 
skills. 

Finally, we want to make clear that this book is not just a book 
containing reprints of conference papers. The editors selected papers out of 
more than one hundred conference submissions based on clarity, relevance 
to the conference theme, quality, and scope of the innovation described. We 
then applied a full editorial process, requiring authors to revise their papers 
in such a way that we could deliver a book containing chapters that 
addressed the central theme from various perspectives. This is a process that 
takes time from both the editors as the authors. The time and energy placed 
in these activities has provided what follows. We trust you will reap the 
benefits. 



Lex Borghans, 
WimH. Gijselaers 
Richard G. Milter 
John E. Stinson 
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PARTI 



LEARNING IN A CHANGING WORKPLACE 



Developing Added Value Skills Within an Academic 
Program Through Work Based Learning 



Stewart Falconer & Malcolm Pettigrew 

Department of Economics, Napier University, Edinburgh, Scotland 



1. INTRODUCTION 

Charles Handy argued in ‘The Age of Unreason’ (1989) that there were 
fundamental changes taking place in organizational life. His suggestion was 
that organizations were evolving into what he termed the ‘shamrock’ model 
with three groups of workers - core, contract and temporary or flexible. 
While university graduates of the future may see a preference for 
employment in the ‘core’ group where the attraction of at least perceived 
permanency of tenure is available, the likelihood is that these graduates can 
expect to fill roles in any of the three categories at different times in their 
working life. They need to be prepared for the challenges inherent in this and 
Harvey et al (1997) anticipate this through their references to the emergence 
of the ‘portfolio worker’ who has accumulated a portfolio of skills and 
experience to enable him or her to obtain and undertake the temporary, 
flexible, contract, consultancy or core work at different times. In general 
terms, Handy (1989) and Harvey (1997) subscribe to the view shared by 
Guirdham (1995) that the nature of work, the nature of organizations and the 
structure of the workforce have all changed and will continue to change. 

3 
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In contrast to this perception of change, it can certainly be argued that 
perhaps working life is not changing that much in terms of permanency of 
employment and, for many years, workers have moved between jobs. At the 
same time, a considerable proportion of the are very likely to remain with 
the same employer for a major part of their working life. However, there is a 
view that people can no longer expect to work for the whole of their lives in 
one occupation and for one employer. As Harvey et al (1997) say “a 
guarantee of lifetime employment is increasingly unrealistic in many 
organizations and ... matching the lack of organizational loyalty to the 
individual, mobile workers are unlikely to be loyal to the organization.” 
Many aspects of working life have become more flexible and Handy (1989) 
has referred to the need for a ‘portfolio of activities’ based on professional 
and technical knowledge but also on more personal skills which individuals 
can offer to a number of different organizations. People need to accumulate 
their portfolios of experience and expertise incorporating skills which can be 
transferred to all of these different organizations. Pugh and Hickson (1996) 
mention Mckinsey's estimate that by the year 2000, 80% of all jobs will 
require cerebral rather than manual skills, a complete reversal from half a 
century ago and, while a proportion of these cerebral skills will be seen as 
technical or professional, it seems reasonable to anticipate that a substantial 
number will be transferable. 

This paper will focus on ways in which higher education can assist 
undergraduates to prepare themselves for what seems from the above views 
to be a changing workplace culture. Specifically, it will examine the 
potential of work based learning, through the experience of a work 
placement incorporated in an undergraduate program, to assist students in 
the acquisition of what are commonly known as transferable skills or 
competencies and which are so vital in the workplace today. Those skills 
which, once acquired, can be used to enable individuals to develop their 
careers in the flexible employment market. 



2. BACKGROUND AND RESEARCH 

In an effort to demonstrate the potential benefits of work based learning 
in the acquisition of transferable skills, we shall review our practical 
experience in the Department of Economics at Napier University through the 
inclusion of work placements as part of an undergraduate program. 
However, prior to doing so, it is worth spending some time examining recent 
developments in and attitudes towards work based learning and transferable 
skills. 



Work Based Learning 
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2.1 Work Based Learning 

Harvey, Moon, Geall and Bower (1997) have systematically explored the 
views of a wide range of employers and recent graduates to identify the 
nature and extent of the knowledge, abilities and skills that graduates will 
need in the twenty-first century if they are to be successful at work. 
Respondents overwhelmingly endorsed work-based placements as a means 
of helping students develop the attributes necessary for that success. Their 
conclusions included the view that placements were seen by employers and 
graduates as the single most significant element of the majority of degree 
programs; that students who have experienced a work placement are in the 
main better prepared for work; that placements can offer real opportunities 
for students to decide on a future career path; and, that there is considerable 
support for work placements to provide students with opportunities to 
develop an awareness of organizational culture and opportunities for s ki lls 
development. The authors concluded that younger, full-time students, other 
than those who had had a significant placement experience on their course, 
left university with little idea of the nature and culture of the workplace and 
initially found it difficult to adjust to working life. ‘Work placements were 
one of the most regularly mentioned suggestions by the respondents for 
helping students towards success at work, improving links and bridging the 
‘skills gap’. Work experience helped to develop a culture of adaptation to the 
real world of work’. It is perhaps reasonable to speculate that there would 
have been an adverse effect, at least in the early stages, on the ability of 
those students without the placement experience to contribute productively 
within the work environment but this is outside the scope of the research 
undertaken to date. 

This endorsement of placements by Harvey et al (1997) comes some time 
into the life cycle of work based learning. In the UK, the concept began to 
take on a prominent role in the 1950s through the introduction of ‘Sandwich’ 
courses, initially in areas such as engineering, but with a rapid extension into 
a wider range of fields, notably and perhaps not surprisingly, business 
studies (Brennan and Little, 1996). However, going back further than that, it 
can perhaps be argued that the integration of education and training or 
practical experience into a unified learning experience has always been very 
much a part of University courses in medicine and related subject areas. At 
the other end of the spectrum, there is no reason why work based learning 
need only be a component of what we might term the ‘vocational’ courses. 
Hamm (1998) puts forward the proposal that students of arts and social 
sciences would be just as able to bring creativity, initiative and enthusiasm to 
a work placement and, in terms of broadening out their career horizons, we 
could speculate that they would be just as keen to do so. 
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While work based learning is an important component of many 
undergraduate programs, particularly in the newer, vocational Universities in 
the UK (which includes Napier University), the Dealing Report (1997) on 
higher education in the UK has placed more emphasis on the need to make 
students more familiar with the world of work. According to a recent survey 
at Warwick University (Purcell & Pilcher, 1996), students themselves point 
to placements as being one of the most rewarding elements of their courses. 
The decision to incorporate a work based placement in the B.A. (Honours) 
degree in Financial Services at Napier University was based on the 
expectation that a vocational placement which related directly to the degree 
course had the potential to enable the student to gain experience which 
augmented theoretical studies. Our experience, which will be demonstrated 
in the latter part of this paper, is that the placement can broaden out 
knowledge and understanding of an organization and also of working life, 
not least through providing the opportunity to acquire transferable skills, 
enabling the student to demonstrate that they can apply in a practical 
environment what they have learned at university. 

2.2 Transferable Skills 

If then, work based learning is already seen as an increasingly significant 
component of undergraduate programs, it is worth looking at the value it 
adds in the development of student skills. A useful point of reference in this 
is the report prepared by Davies (1990) for the UK Council for National 
Academic Awards on Experience Based Learning in the Curriculum. Davies 
examined the development of work based learning in terms of how 
placements are developed and managed, the nature of the experiential 
learning which occurs within the placements, the different perceptions of 
academic staff, students and employers and, not surprisingly, the costs and 
benefits. He also looked at governmental and quasi-govemmental attitudes 
to the development of work based learning ranging across the statement from 
the Royal Society of Arts (1979) that “learning is to be by active 
involvement and related to experience ... to provide an appropriately skilled 
workforce for the future”, to the Secretary of State for Education (1988). 

“The curriculum should bring out . . . relevance to and li nks with students’ 
own experience and background and their practical application and 
continuing value to adult and working life ... the development of general, 
personal qualities and competencies ... for example, self-reliance, self- 
discipline, enterprise, social responsibility ... the ability to work 
harmoniously with others, an ability to apply knowledge and use it to 
solve practical, real-life problems.” 
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More recently, Harvey and Knight (1996) refer to the Quality in Higher 
Education (QHE) project undertaken in 1992 which suggested that university 
staff, students and employers all regarded the development of transferable 
skills as an important outcome of higher education with employers seeking a 
range and balance of these skills in their recmits. A considerable list of these 
skills could be compiled, skills which will in many cases not be an intrinsic 
part of the study program. Harvey and Knight (1996) list willingness to 
learn, team work, communication, problem-solving, analytic ability, logical 
argument and ability to summarize key issues along with a range of more 
personal attributes such as commitment and energy. Greenwood, Edge and 
Hodgetts (1987), who have undertaken three research studies across a period 
of some thirteen years into the characteristics or skills which managers 
expected of business graduates, identified three groups, knowledge, skills 
and traits or attributes. The knowledge category included the technical or 
academic skills while traits consisted of more personal attributes such as 
Harvey and Knight's commitment and energy. What we have regarded as 
transferable skills come under Greenwood et al’s heading of ‘skills’ and, 
across the three studies completed in 1973, 1983 and 1986, the same four 
groups of skills were most popular amongst the managers who responded: 

— communication; 

— analyze data, propose solutions, make decisions; 

— plan, develop, organize, co-ordinate; 

— work with others, motivate. 

Their conclusion was that the results followed a continuum which 
emphasized people-orientated skills and, consequently, their view was that 
universities should focus on these people-orientated aspects in business 
education. 

In support of these latter two studies, Guirdham (1995) concluded that 
across the five year period from the beginning of the decade, the value and 
need for inter-personal skills development had been widely recognized. 
Changes in organizational life had increased the demands on the inter- 
personal skills of people at work, partly through a reduction in the degree to 
which work is organized through procedures, rules, authority and 
supervision. To take decisions, people at work need information and, despite 
the increasing use of information technology, a lot of information continues 
to be obtained through contact with other people, resulting in a demand for 
communication skills. In addition, she concluded that, since team work is an 
integral component of the workplace, the need for people to be able to ‘gel’ 
is vital. These views are supported by Harvey et al (1997) who say that 
“team working, communication and inter-personal skills are inextricably 
interlinked in the delayered organization. For instance, it is highly unlikely 
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that someone with underdeveloped inter-personal s kil ls would be able to 
engage effectively with colleagues and clients, let alone inspire a team.” 

2.3 Acquiring the Skills Through Work Based Learning 

So, a body of opinion which says that work has changed and that 
university graduates must be prepared for the new work environment. A 
substantial part of this preparation is the acquisition of the transferable skills 
which employers are seeking in their graduate recruits. Additionally, it has 
been acknowledged that work experience through work based learning can 
be very beneficial in preparing students for the world of work. It seems fair 
to suggest, then, that, if work based learning through the medium of work 
placements incorporated into an undergraduate program can assist in the 
development of transferable skills, it could take on a substantial weight of 
responsibility for the future development of the workforce and the economy. 

This, of course, is a substantial claim and we recognize this. It is not our 
intention here to examine the more general and perhaps wide-ranging 
benefits of work based learning but rather to look specifically at the extent to 
which work based learning or experience of work can help efforts within the 
undergraduate program in facilitating the development of transferable s ki lls. 
The result should be benefits to the student in terms of an easier integration 
into the world of work and, even more specifically, an easier passage 
through the prospective employer’s assessment process. At the same time the 
employer should obtain an employee who will adapt more readily to the 
work environment, require less training and induction and operate 
effectively and productively more quickly. According to the Washington 
State Work Based Learning Resource Center, in 1991, 3,000 employers 
identified attitude, communication skills and previous work experience as 
the three most desirable qualities sought in a new employee. Since that time 
assessment methods have become increasingly sophisticated in the area of 
graduate recmitment and this tends to point towards an increasing demand 
for transferable skills and work experience. 

In an effort to emphasize the points made so far, and highlight the need 
for and desirability of these transferable skills and, of course, to make the 
case further for work based learning in the acquisition of these skills, Lane 
and Robinson (1994) emphasized the need for partnerships between business 
and education if employers were to keep their workforce skilled and at the 
forefront of change. They saw the challenge for academics in devising 
learning opportunities which achieve a natural balance between knowledge 
and understanding and the ability to perform competently in real world 
situations. Being successful at work is not just about carrying out the various 
technical tasks competently. The very fact that organizations are designed 
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and structured creates a need to work with others, often in teams, hi fact, it is 
very much the exception to find someone who is not involved in a team of 
some sort at work, even in academia! It is essential to be able to 
communicate well with others both on a social and professional level in 
addition to being able to perform the technical functions specific to the job. 
As Lane and Robinson (1994) say “. . . it is often these less tangible aspects of 
competence, rather than the technical skills, that distinguish between 
successful and less successful individuals.” 

It would also be interesting to examine how best to assess the acquisition 
of these skills and the various ways in which students should be required to 
demonstrate their acquisition - what evidence should they produce and what 
evidence can they produce. It is also very much the case that undergraduates 
require to take on substantial responsibility for their own learning in the 
work based learning environment - much more than they have traditionally 
been used to doing. However, these issues are not the direct concern of this 
paper albeit that they are critical parts of the work based learning experience. 
The focus here is on the extent to which transferable skills, which will be of 
value to employer and employee, can be acquired through the work based 
content of an undergraduate program. In the Department of Econo mi cs at 
Napier University, three years experience of work based learning has been 
accumulated. This takes the form of a six month work placement with an 
organization within the financial services sector and it is undertaken by the 
students on the full-time BA (Honours) Degree in Financial Services in the 
semester prior to the commencement of their final year of study. 

So, having set the scene in terms of some background, the discussion will 
now move on to examine practical experience in this area and draw some 
conclusions on the effectiveness of the work based learning content of our 
undergraduate program in providing students with the opportunity to acquire 
transferable skills. 



3. 


SURVEY 


3.1 


Methodology 



The study was conducted by means of a non-attributable questionnaire. 
This was distributed to the three cohorts of students who had completed the 
Work Based learning module within the Financial Services honours degree 
program, and for whom current addresses were held. The total sample was 
40; consisting of 13 current students and 27 graduates (10 graduates 98 , 17 
graduates 97 ). The overall response rate was 65%, consisting of current 
students, 10 (77%), graduates 98 , 6 (60%), graduates 97 , 10(59%). 
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3.2 Findings 

The survey asked two principal questions. Firstly we investigated the 
skills that the students considered were most important in the workplace. 
The range of skills listed were based on those considered important by both 
students and employers for professionals in the workplace. (Eraut, 1994; 
Hanson et al., 1996). 

The findings for this first question are shown in table 1 . The expected 
mean was 5.5, on the basis that the student ranking of the individual skills 
would not be consistent, but that each individual would have an individual 
preference. The first column shows the average ranking for the total 
population for which we had 24 useable responses (60%). Oral 
communication and Team Working were very highly significant in terms of 
importance of the skill, whereas negotiation and innovativeness were very 
highly insignificant in terms of importance. 

When examining the responses of the sub-groups, it can be seen that only 
oral communication is highly significant and innovativeness very highly 
insignificant across all the sub-groups. The results are generally mixed, 
although three skills show a trend over time, with a further one skill showing 
an improvement to the first graduate group. 



Table 1. Student's ranking of the importance of skills for the workplace 





All 


Students 


Graduates 


Graduates97 


Graduates98 


Teamworking 


3.83*** 


2.60*** 


4.71* 


5.78 


2.80*** 


Oral comm. 


3.79*** 


3.80*** 


3.79*** 


3.67*** 


4.00** 


Written 

comm. 


5.08 


6.10 


4.36** 


4.00*** 


5.00 


Problem 

solving 


6.04 


6.10 


6.00 


6.22* 


5.60 


Information 

handling 


5.25 


4.50** 


5.79 


5.78 


5.80 


Negotiation 


7.33*** 


9.00*** 


6.14 


5.44 


7.40*** 


Listening 


5.08 


5.00 


5.14 


5.56 


4.40** 


Planning 


4.79 


5.50 


4.29** 


5.00 


3.00*** 


Resourcefuln 

ess 


6.21* 


5.10 


7.00*** 


6.11 


8.60*** 


Innovative- 

ness 


7.58*** 


7.30*** 


7.79*** 


7.44*** 


8.40*** 



All n=24. Students n=10, Graduates n=14. Graduates97 n=9, Graduates98, n=5. 

*** significant at 99%, ** significant at 95%, * significant at 90%. Expected mean = 5.5 



It is noted that the average ranking for the graduate group shows a much 
narrower variance with the trend continuing through the sub-groups, the 
longer the group has been away from university. Thus reflecting that 
different respondents rate different skills more highly than do others. This 
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may be an indication that all the skills are important but at different stages of 
their careers and different job characteristics, the importance of each s ki ll 
will vary. However, this needs further investigation as the current study is 
limited by a small sample size and all the respondents studied on the same 
degree program. 

The second part of the study asked the respondents to rank statements 
regarding their experience on the work placement as to whether they agreed 
or disagreed with the statement based on a four-point scale. They were asked 
to give their response to 14 statements related to skills developed on the 
placement: 

1. The placement module better equipped me to work as part of a team. 

2. The placement enabled me to participate in group problem solving. 

3. The placement developed my skills in seeking out innovative solutions to 
problems. 

4. It improved my skills in handling information. 

5. It developed my skills in finding resolutions to different types of 
situation. 

6. It enabled me to identify the critical issues with regard to problems. 

7. It enabled me to develop my skills in diagnosing the exact nature of 
problems. 

8. It enabled me to plan my work more efficiently and effectively. 

9. It developed my negotiation skills. 

10. It developed my skills in researching information. 

11. It improved my written communication skills. 

12. It developed my listening s ki lls. 

13. It developed my resourcefulness in obtaining information. 

14. It helped the clarity of my communication skills both oral and written to 
improve. 

Table 2 provides a summary of the results for which all 26 respondents 
provided useable data. It is significant to note that sample as a whole 
perceived the Work Based Learning to be beneficial. Furthermore with the 
exception of team working and listening ski ll s, the graduate group ranked all 
the skills more important than the student group. Moreover it is only within 
the student group that any skills (innovative solutions and negotiation) score 
higher than the expected mean of 2.5, albeit not at a significant level. 
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Table 2. Student's perception of work placement to skill development 





All 


Students 


Graduates 


Graduates97 


Graduates98 


Teamworking 


1.81* 


1.80* 


1.81* 


2.00 


1.50* 


Problem 

solving 


2.08 


2.20 


2.00 


2.30 


1.50* 


Innovative 

solutions 


2.12 


2.60 


1.81* 


1.80* 


1.83 


Information 

handling 


1.46** 


1.50** 


1.44** 


1.40** 


1.50* 


Finding 
resolutions to 
different 
situations 


1.81* 


1.90 


1.75* 


1.80* 


1.67* 


Identify critical 
issues 


1.85 


2.10 


1.69* 


1.90 


1.33** 


Diagnose 
nature of 
problem 


2.08 


2.30 


1.94 


1.90 


2.00 


Plan work more 
efficiently 


1.69* 


1.90 


1.56** 


1.50** 


1.67* 


Negotiation 

skills 


2.31 


2.60 


2.13 


2.40 


1.67* 


Researching 

information 


1.92 


2.30 


1.69* 


1.80* 


1.50* 


Written 

communication 

skills 


1.88 


2.10 


1.75* 


1.60* 


2.00 


Listening skills 


1.85 


1.80* 


1.88 


1.80* 


2.00 


Resourceful- 
ness in 
obtaining 
information 


2.00 


2.10 


1.94 


2.10 


1.67* 


Clarity of oral 
& written 
communication 


1.77* 


1.90 


1.69* 


1.80* 


1.50* 


All, n=26. Students n=10. Graduates n=16. Graduates97, n= 


TO, Graduates98, n=6. 


*** significant at 99%, ** 


significant at 95%, 


♦ significant at 90%. Expected mean = 2.5. 



The results for the graduate group as a whole, show that more than half 
of the skills were perceived positively at the 90% significance level. 
Furthermore in examining the sub-groups for the graduates, 6 ski ll s: 

• innovative solutions 

• handling information 

• diagnosis of problems 

• planning 

• written communication 

• listening 
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become more positive with the graduate97 group. This suggests an 
appreciation of the skills developed in the module increases over time. 
However a caveat should be added that we are comparing different groups of 
students and therefore the differences may be due to this and not an 
appreciation of the skills and also again that we are dealing with relatively 
small groups. 

The skills that were ranked important in table 1 also tend to show a 
positive perception from the student in relation to the development of that 
skill on the work placement. Team working and oral communication are 
very highly important in table 1 and are significant in table 2 whereas 
negotiation and innovativeness are very highly unimportant in table 1 and 
are not significant in the development of skills with both having an average 
ranking in excess of 2. 



4. CONCLUSIONS AND RECOMMENDATIONS 

This preliminary study, whilst acknowledging the limitations placed upon 
the results due to the narrow experience and small size of the sample does 
suggest that Work Based Learning is both a valuable and useful experience 
from the student’s point of view. It appears to offer the opportunity to 
develop the transferable skills demanded by employers in the 1990s. The 
conclusions drawn can only be tentative as comparisons are being made 
between different groups of students. 

This study, in order to substantiate the findings, requires to be developed 
in a number of ways. Firstly a much larger study requires to be conducted to 
eliminate any small sample bias. Furthermore we would require to be sure 
that it is in fact the Work Based learning module that provides the positive 
experience suggested in the study and that this is not a result of the 
university experience in general. Accordingly a larger study should include 
students and graduates that have studied a more traditional curriculum 
without the benefit of a work placement. It should include students from a 
wider number of institutions to exclude any institutional bias and also a 
wider spectrum of programs to allow for any bias related to the type of 
degree program. This wider study would add validity to the generalizability 
of the findings and also would eli min ate any bias due to the self selective 
nature of narrow programs. Further improvements could be made by 
stratifying the sample by age at commencement of the program of study and 
also ascertaining those students that have prior work experience. 

Secondly, a larger study should be conducted on a longitudinal basis 
tracking the same group of graduates over a period of say five years. This 
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would ascertain if the graduate’s perception of Work Based Learning does 
change as their experience of the labor market increases. 

Lastly, it would be helpful to be able to measure the input into the 
development of these s kil ls made by employers. This could perhaps be 
established by funds expended on graduate training programs or even time 
spent in training by graduates. This would allow an analysis to be conducted 
to establish if the benefits perceived by graduates are solely related to Work 
Based Learning by examining the different inputs provided by the 
employers. 

Overall this would enable an evaluation to be made of the real benefits of 
programs including Work Based Learning as against the more traditional 
programs. The results would provide a basis for potential employers as to the 
suitability and cost of recruiting graduates from the different backgrounds of 
study. The universities can then evaluate whether the Work Based Learning 
truly enhances the student’s learning and whether the resources employed in 
this type of program are justified. 
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1. CONTEXT 

Much has been written concerning the value of learning and education in 
delivering competitive advantage, particularly in knowledge based service 
industries (Karpin, 1995; Senge, 1990). There has also been much written 
about the necessity for real individual behavioral change to underpin 
effective organizational and cultural change (Quinn, 1996). The Queensland 
Audit Office (QAO) is a service knowledge-based organization, which 
despite having a legislative monopoly recognizes the competitive nature of 
its business. Over the last six years, QAO has undergone significant 
structural and organizational reform and has focussed on changing the 
people and the culture to align individual behavior with organizational 
values and direction. QAO has focussed on developing competitive 
advantage through development of its people, and particularly its middle 
managers. 

QAO has been running its own in-house leadership programs since 1994. 
While these programs have relied on a range of external and internal 
speakers, the facilitation role had been managed generally by an executive 
with support from QAO’s Professional Development Officer, and this was 
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becoming increasingly time consuming as the programs gained 
organizational acceptance and consequently more participants. 

In 1991, the Australian Government commissioned an Industry Task 
Force on Leadership and Management Skills. The Task Force’s charter was 
to advise on measures to strengthen management development and business 
leadership within Australian enterprises. It was asked to identify effective 
management practices in a range of areas, to raise awareness of the need for 
improved leadership and management skills and to foster enterprise 
commitment to management development. In the report, Karpin (1995) 
identified a number of limitations to current Australian leadership and 
management practices. 

“The Task Force’s Research Program provides ample evidence that 
Australian enterprises and managers are failing in six critical areas: namely: 

• low levels of education and training undertaken; 

• over-reliance on short courses; 

• over-emphasis on current rather than future skills; 

• failure to handle the transitions from specialist to manager; 

• failure to link management development to strategic direction; and 

• failure to evaluate the effectiveness of management development 
activities.” 

QAO’s internal program was designed to address some of these issues, 
but there was still a lack of rigor about the program, and participants put in a 
lot of effort with no academic recognition. Early in 1998 the QAO began 
negotiations with the Graduate School of Business to have the programs 
accredited by them so that: 

• there would be acceptance and recognition of the high standard of the 
programs, both internally and externally; 

• the design and facilitation role could be shared more widely and become 
less dependent on the good intentions of a few people; 

• QAO would gain access to academic staff to present and run sessions; 

• there would be greater academic rigor in the program; 

• QAO would be able to market its programs within the government 
sector; and 

• QAO participants would gain credit towards a recognized post graduate 
management award. 

This accreditation process was finalized in June 1998, and the Graduate 
School of Business (GSB) has effectively taken over the supervision of these 
programs. This paper discusses the background of both organizations, the 
process used to attain accreditation, what has been learnt, and concludes with 
the expected outcomes for each organization. 
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2. BACKGROUND - A QUEENSLAND AUDIT 
OFFICE PERSPECTIVE 

The Department of the Auditor-General was established in Queensland in 
1860. Being an organization comprised primarily of auditors, it is not 
surprising that the culture of the office has been strongly conservative, 
concerned with detail, and fairly risk averse with a strong focus on 
centralized control and decision making. The legislation establishing the 
position of Auditor-General and the Queensland Audit Office places 
personal responsibility on the Auditor-General to give audit opinions and 
report on matters as required, and in the past this has led to a centralized 
decision-making style of management. 

The QAO has a monopoly on all audits of public sector entities (some 
620 in total including departments, local authorities, statutory bodies, and 
controlled entities of these organizations). The large majority of effort is 
devoted to financial and compliance regularity audits, and in the last two 
years, QAO has also been auditing performance management systems. 

Management as a concept has been well understood in the QAO, with its 
focus on problem solving, has not always been the focus. As such, training 
for managers had given little attention to leadership development, and 
focussed on the planning, controlling, and monitoring aspects of 
management. “Soft ski ll s” were perceived as being less useful for auditors, 
who were predominantly interested in doing audits and saw other corporate 
activities and training on matters other than technical accounting and 
auditing issues as of much lower priority. 

2.1 Outline of 1997 Leadership Development Program 
(LPD) 

QAO’s LDP was based around developing Qld Public Service Senior 
Executive Service (SES) Officer competencies: 

• Corporate Leadership 

• Policy Development & Advice 

• Managing for Outcomes 

• Developing & Managing Resources 

• Representation & Communication 

• Self Management & Self Development. 

Potential applicants were asked to complete an expression of interest 
setting out why they should be selected for the program and providing 
examples of either demonstrated or potential leadership ability. Participants 
were chosen by QAO senior management having regard to their application 
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and referee reports, and also from personal observation of the staff involved. 
The program components were workshops, a workplace project, learning 
sets, and mentoring and possibly work placements. At the start of the 
program, participants completed a range of s kill s assessment tools including 
the Kouzes and Posner Leadership Practices Inventory; a Management Skills 
Self-Assessment (based on SES Competencies and reviewed by their 
managers); a Learning Styles Assessment; and a Team View 360-feedback 
process. The detailed program design was based on the results of the above 
assessments, although the overall corporate need was to develop leadership, 
self-management, and self-development, and change management s kil ls. 

Participants were required to read a range of texts from a prescribed list, 
and were provided with 4-6 articles every 4-6 weeks to read and discuss 
within the learning sets. Each person completed a work-based project 
involving organizational development issues. The participants also worked 
through case studies. 

The program was a success, and led to a major focus across the 
organization on leadership development. In terms of individual outcomes, all 
five initial participants were promoted to senior management positions while 
in the program. Those people have taken on a significant role in facilitating 
other management development programs and have undertaken other 
corporate change projects. However, the program was resource intensive; 
lacked a thorough conceptual focus; and was largely dependent on 
continuing time consuming personal involvement of the facilitator. For these 
reasons, the Graduate School of Business at QUT was approached to advise 
on improvements to the program and to discuss accreditation. QAO and 
QUT have had a long association, and many QAO staff are graduates of 
QUT. 



3. BACKGROUND - THE BRISBANE GRADUATE 
SCHOOL OF BUSINESS PERSPECTIVE 

The Brisbane Graduate School of Business (BGSB) is a newly 
established (1995) post-graduate School within the Queensland University of 
Technology’s (QUT) Faculty of Business. The BGSB offers a range of 
postgraduate, multi-disciplinary, applied programs leading to the award of 
MBA, Graduate Diploma in Business Administration or Graduate Certificate 
of Management. 

QUT promotes itself as ‘The University for the Real World.” As the 
“real world” changes, the BGSB is faced with the challenge of providing 
current, relevant applied learning opportunities to business and the 
community. Because of this “real world” focus, the BGSB has moved 
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towards a range of initiatives in delivery and teaching that reflect 
contemporary business concerns. These include, the use of case studies, 
engaging business managers and leaders to conduct classes and the 
increasing use of real time projects in companies as part of course work. 

While individual enrollment and company-sponsored enrollment in the 
MBA program is growing, it was felt that there was a significant number of 
opportunities for the BGSB to work with corporations to provide specially 
tailored programs. These programs would be designed to meet 
organizational needs, but also incorporate the conceptual rigor more 
normally associated with academic programs. The assumption behind such a 
partnership is that the worth of any program would be enhanced for the 
organization and the individual participants would receive external 
recognition for their learning achievement. 

Fulmer (1997) discussing the relationship between practitioners and 
universities states: 

“University should provide an individual with exposure to cutting edge 
thinking in a variety of disciplines. It should develop a commitment for 
honest inquiry and an attempt to seek new answers to old questions. 
Corporate experience adds the dimension of relevance. In a business 
setting, ideas have little currency unless they can be meaningfully applied 
in a specific situation.” 

Increasingly large organizations are establishing their own training and 
educational facilities and are running their own programs for middle and 
senior managers. In 1993 Jeanne C. Meister (Fulmer, 1997) identified 30 
companies with corporate universities. By 1996 she reported that almost 
1000 firms had begun or were actively investigating the feasibility of a 
corporate university. 

The reasons for these developments range from a commitment by the 
organization to lifelong learning for employees, to disenchantment with the 
inflexibility of academic institutions in meeting their needs. 

For smaller organizations, setting up their own educational facilities may 
not make economic sense. Even for large companies, setting up their own 
universities as has happened in the United States, may be duplicating 
resources that exist within local academic institutions. The ideal solution 
would appear to be for business organizations to work with academic 
organizations to design and deliver leadership development programs that 
meet the immediate and future needs of managers and potential leaders and 
that build on the expertise and resources of both organizations. If a common 
understanding can be achieved, all parties, and particularly the participants 
in the learning process, have much to gain. 
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4. THE PROGRAM APPROACH 

The Assistant Auditor General at the QAO and the Director of the MBA 
Program at the BGSB looked at how they could design and deliver a 
Leadership Development Program that met the academic requirements of a 
post graduate business qualification, while meeting the development needs 
of the learners and the expectations and organizational demands of the QAO. 
This meant considering issues of content, learning process, timing, 
assessment strategies, mutual expertise and resources, administration and 
control, and relating learning to organizational as well as individual needs. 
The reasons that this conversation took place were concerns within the QAO 
about the continuation of the leadership program at the QAO and the 
relationship that already existed between the Assistant Auditor General and 
the Director of the MBA program. Before joining the BGSB, The Director 
had a career as a senior manager in the public sector and had been a 
consultant to the QAO, assisting with their strategic planning and change 
management processes. The relationship that was already established and the 
specific knowledge of the QAO enabled a partnership to be developed more 
easily than would otherwise have been the case. 

There are traditionally a number of different ways in which leadership 
training is delivered. Jay Conger (1992) identified 4 categories of leadership 
training: Personal growth, skill building, conceptual development, and 
feedback. Csoka (1996) provides a simple overview of these strategies, 
which is used as a framework to understand the development and structure 
of the QAO program. 

4.1 Personal Growth 

Leadership training programs featuring personal growth emphasize the 
need for managers to become more aware of their inner talents, abilities, and 
limitations. QAO is very supportive of this approach and has included it as a 
critical element of their leadership program. The GSB, in reviewing its 
programs and their effectiveness in training competent managers is moving 
more to a recognition of personal development as an integral part of being 
successful in MBA programs, and as a manager. This is reflected in the 
marketplace where leading executive placement organizations have 
identified to BGSB personnel that the key attributes providing competitive 
advantage to individuals in the current employment market are self 
awareness, communication skills, and a capacity to work with others. 

Because the employing organization recognizes the importance of 
personal growth as a critical element of leadership training, some of the 
difficulties identified (Csoka, 1996) when applying this new awareness in 
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the work place are overcome. The support of the Auditor-General, as the 
CEO of the organization, has been particularly important in ensuring that 
participants in the program are able to use their new found self awareness. 

QAO provides support and recognition for the personal growth element 
of the program through: 

• The design of the program includes the requirements of each 
participant’s own learning plans; 

• Learning sets that provide mutual support for participants, coaching in 
leadership behaviors as well as a forum for resolving current business 
problems; 

• Participants have either been promoted to more senior positions, or have 
been given special high profile corporate projects to complete. 

4.2 Conceptual Development 

This has traditionally been the strength of university leadership programs 
and works on the premise that if you know the concept you can act on it. 
Although this approach has fallen into disfavor in some quarters as being 
“out of touch” with the real world it does focus on the expertise required by 
leaders in contemporary society and provides the conceptual tools to deal 
with a rapidly changing environment. The structured program offered to 
QAO incorporated the thorough conceptual focus that was considered a 
welcome addition to the in-house leadership program. 

QAO participants have benefited from the expansion of the conceptual 
framework part of the curriculum through being able to see the range of 
possible approaches, and being able to debate within the learning sets the 
applicability or practicality of any particular approach within their own 
organization. This approach to learning has also increased their confidence 
in their current roles, as the identification of the academic frameworks that 
support particular leadership responses diminishes the occasional feeling of 
isolation when dealing with particular business issues. Because most of the 
participants have worked only within the one organization throughout their 
working life, they have not had the exposure to many different 
organizational cultures and leadership styles, and the conceptual framework 
has proven to be illuminating by reducing the limits on experiential 
diversity. 

4.3 Feedback 

Feedback was a critical element in the Leadership Development Program 
as delivered at QAO. Individuals had to compete for places on the program 
and were tested against a wide variety of leadership, management, and 
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personal style assessment tools. This element of the program will remain an 
important element of the program and assessment tools are used as part of 
assessment early in the program, and at the end of the program. 

Participants gain feedback from the facilitators, lecturers, and from each 
other in the learning sets. The depth of discussion in the learning sets and the 
approach taken to how these particular articles/theories might apply within 
QAO also allows the participants an opportunity to learn from each other. 
The facilitators/tutors play a strong mentoring role within the program, and 
this is also an important part of the leadership development process. 

4.4 Skill Building 

This is perhaps the most commonly used method for leadership training 
because it has an intuitive appeal because of the practical approach which 
organizations need. This element of skill building is integral to the program 
through the incorporation of real projects as part of the course learning 
activities and assessment. 

One example is one of the units already conducted, entitled 
Organizational Analysis and Consulting. The primary assessment in this unit 
is a report on a “real time” consultancy for a client organization. The 
learning groups within QAO contracted with the Assistant Auditor General 
to develop issues papers that would inform the QAO’s strategic planning 
process. These issues papers had to identify the significance of the issue to 
the organization, make recommendations to the senior executive on how the 
issue could best be addressed and clearly articulate the implications for the 
organization of implementation of their recommendations. The report 
produced was incorporated into the strategic planning process within the 
QAO and had implications for the participants, senior management and the 
organization as a whole. 

The conceptual frameworks taught during the course provided tools for 
the learners to use in collecting and analyzing their data, understanding how 
their organization worked and would respond to the changes they were 
recommending and the relationship that exists between the consultants and 
their client. Their presentation to the senior executive and the report 
prepared constitute a significant element of the assessment for the unit. 



5. PROGRAM DETAILS 

Built on the foundation laid by the Leadership Program, the Graduate 
Certificate of Management is an award-bearing program developed jointly 
by the BGSB at QUT and the QAO. 
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The program includes existing units from within the MBA program but 
the possibility exists in the future to include newly created units if required. 
These units include: 

• Personal Development and Ethics; 

• Human Resource Management; 

• Organizational Analysis and Consulting; 

• Leadership I and II 

The units were chosen because they reflected the areas that the QAO 
wished to develop, and included the possibility of practical in-house projects 
as part of the learning experience. With the introduction of a 2nd cohort, it is 
possible to change the subjects offered to meet the needs of the organization 
and the individuals. The Personal Development and Ethics unit and the two 
Leadership units are considered essential, while the other two subjects may 
be altered in response to changing needs. 

The delivery is in-house at QAO and uses a variety of methods based 
around learning sets. Information is provided to the learning sets through 
input sessions and workshops conducted by QUT and other providers and 
through independent learning and research supported by suggested reading. 
The learning sets are led by QAO staff members who are recognized as 
tutors of the Brisbane Graduate School. Participants have the opportunity of 
testing and applying their knowledge through discussion, practical projects, 
presentations, and assignments. 

The program commences with significant self-assessment and the use of 
the Enneagram, 360 feedback tools and the development of a personal 
learning plan. This leads to an individua li zed learning plan that may require 
individuals to undertake different activities to ensure meeting the learning 
outcomes of the program as a whole. The learning sets are the focus of 
discussion and debate about what is learned. The program will conclude with 
a second self-assessment and 360-feedback process and the completion of a 
further ongoing leadership development plan. QAO staff acting as QUT 
tutors, supported by a member of the Brisbane Graduate School Academic 
Staff, facilitate the learning sets. 

The Personal Development and Ethics Unit, as the title suggests, looks at 
models and frameworks for personal development and success. It explores 
personality models, interpersonal interaction, and the impact of a changing 
work environment on the individual. The focus of this unit is clearly in the 
personal growth area, though conceptual frameworks are used to facilitate 
the process of increasing self awareness. The unit raised a number of issues 
for participants whose previous experience of study had not included self 
exa mi nation. 

The organizational analysis and consulting unit was run at the request of 
QAO in response to a particular organizational need. This unit clearly 
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developed skills within an organizational development framework. Students 
undertook, in groups, a work related project, which had to be completed in a 
way that met the needs of the organization and the academic requirements of 
the unit. The outcome demonstrated enhanced skills of participants and 
improved quality of the project for the organization. 

The 1st cohort is currently undertaking a Human Resource Management 
Unit which will again include a work based project of relevance to the 
organization and focus on skills development within a conceptual 
framework. The final unit, Leadership, to be completed in July 1999, will 
provide a conceptual understanding of leadership but also involve feedback 
and personal growth activities. 

Because of the commitment to ensure that academic standards and that 
all four aspects of management education are integrated into the program, 
teaching staff have had to focus clearly on ensuring diversity in the learning 
and assessment strategies used. 

The assessment for the program is consistent with the assessment for the 
same units run on campus. All assessment is the responsibility of the 
program coordinator at the Brisbane Graduate School. Although the 
assessment component is optional for participants in QAO’s Leadership 
Program, the Graduate Certificate in Management will only be awarded to 
those participants who successfully complete all forms of assessment in 
accordance with QUT requirements. To date all students completing the 
units have been assessed. 

Assessment strategies include: development of a personal profile, a 
personal journal, group presentations, case study examinations, project 
reports, short questions examinations, the development of an individual 
profile of a leader and a personal leadership development plan. 

In developing the partnership considerable attention was given to the 
respective roles of QAO, the Brisbane Graduate School of Business and the 
participants. QAO responsibilities include: 

• recruitment of participants, 

• accommodation for the meetings of the learning sets and the 
input/workshop sessions, 

• preparation for and facilitation of the learning sets, 

• mentoring and support of participants, and 

• the payment of the agreed student fees. 

• QUT’s responsibilities include: 

• overall program coordination, 

• support for the learning set facilitators, 

• all assessment activities, 

• providing readings and reading lists, 
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• the award of the Graduate Certificate in Management to participants who 
successfully complete the program, 

• access by participants to on-campus seminars, 

• input and workshop sessions, 

• providing access to the university library and other support services for 
the QAO facilitators; and 

• off-campus access to student services for participants, such as access to 
student services, electronic database access etc. 

• Program participants are expected to: 

• participate in the learning sets, 

• complete all program activities, 

• undertake reading and home study, and 

• complete assessment components in accordance with their agreement 
with QAO. 

The program now has two cohorts. The first cohort has completed two 

units and will complete the final two units by July 1999. The 2nd cohort 

commenced in January 1999 and will do two units in 1999 and two units in 

2000 . 



6. ORGANIZATIONAL OUTCOMES 

For QAO, there have been ranges of positive outcomes that impact on 

both the current organizational performance and will also have a long range 

impact: 

• Empowered leaders who are changing QAO’s culture to that of an 
empowered leaning organization (Field 1998:74); 

• Changed behavior of participants that has led to improvements in the 
way they lead their teams and the way they contribute to the leadership 
of QAO; 

• Institutionalization of the Leadership Development Program, thus 
ensuring its longevity; 

• Graduate Certificate in Management qualifications for many high 
potential managers; 

• Demonstrated commitment by QAO to the concepts of being a learning 
organization and to truly valuing its people and investing in their 
development; 

• Team building for management teams who now see their collective 
influence as agents of change; 

• Many organizational improvement projects are now listed as 
“assignments.” Being part of real life, they are of great learning value to 
the participants, and QAO gains great benefit from having its own staff 
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carry out these projects within a rigorous framework and for less cost 
(Haynes, 1998); 

• Corporate recognition of the necessity of broadening QAO’s past 
technical base (a key strength) to encompass other skills, and the strong 
links to competitive advantage; 

• There has been a tremendous boost to QAO’s strategic focus and overall 
morale of staff through the activities, behavior, and influence of a highly 
persuasive management team; and 

• QAO’s image and the perceptions of its clients has improved 
enormously through the high profile of the course, its marketing to other 
organizations, and the changed behavior of many senior staff who are 
dealing with clients on a day to day basis. 

The relevance of the program depends on the integration of academic 
input and work experience and this in turn yields organizational and 
individual benefits. QAO is now producing highly qualified and experienced 
leaders who may take up senior management roles in both QAO and the 
Queensland Public Sector. This supports QAO’s organizational aim of 
improving accountability within the Queensland Public Sector. As a long 
term research project, both authors will continue to monitor the effectiveness 
of the program, and its impact on organizational environment, culture, and 
strategic direction. 

From a Brisbane Graduate School of Business perspective this program 
has provided an ideal opportunity to develop and trial a model of leadership 
development that incorporates a wide range of teaching strategies within a 
supportive organizational context which encourages the use of the newly 
acquired knowledge and skills. It also provides an opportunity to observe 
and assess the impact of such a program on individuals and the organization 
in which they manage. There is much to learn about improving the 
effectiveness of learning programs in their capacity to develop knowledge 
and skills that are transferred into the work place. The learning from this 
program can only improve the Graduate School’s capacity to deliver 
effective, relevant and applied management and leadership programs. 



7. KEY SUCCESS FACTORS 

While the program is still in its early days, it is possible to identify a 
number of factors that have contributed to the success to date, and which 
will contribute to its long term success. There has been willingness on the 
part of QAO to accept the conceptual components and academic 
requirements (such as assessment) of the university. The Brisbane Graduate 
School has been willing to incorporate real life, real time projects in the 
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program at times to suit QAO operational requirements rather than the 
university. There has been extraordinary support from the Auditor General 
and the Head of the Brisbane Graduate School which has enabled openness 
and flexibility at all stages of the development and delivery. The mutual 
knowledge and understanding of the organization and its culture has been 
critical in determining the focus of the program, its content, and its delivery. 
There is a degree of trust between the two organizations because of the 
previous experiences of two of the key players. Another success factor has 
been the clear understanding and acceptance of each organization’s 
respective responsibilities. Perhaps most importantly there has been 
willingness on the part of each of the organizations to share ownership and 
to value the contributions made by the other partner. 

The model will no doubt evolve and be improved in the light of 
experience. However, even at this early stage, there is considerable interest 
from other organizations in this as a model for the development and delivery 
of executive development programs, so this may be the first of many. 
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New Training Methods: A Giant Leap of Faith? 
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1. INTRODUCTION 

It is quite clear that there has been a dramatic interest in the use of 
flexible training methods in the past 10-15 years, in the UK. In particular, we 
might consider the following developments: 

• the use of competencies; 

• accreditation systems; 

• an increased emphasis on “in-house” expertise, such as mentoring; 

• the development of open/distance learning programs; 

• a general desire that programs be delivered more flexibly. This has often 
meant that employers want “tailored” rather than “off-the-shelf’ courses. 
Sloman (1993) suggests that training is increasingly likely to play a 

strategic role in the future of many organizations. However, he goes on to 
say that such training is unlikely to be provided by the headquarters of such 
organizations. Rather, it will be provided via flexible means that will include 
the increasingly extensive use of open learning packages. Sloman and others 
(e.g. Littlefield, 1994) would stress the fact that during the 1990s, computer- 
based packages are going to become an increasingly important means of 
providing training. Employers want flexibility in terms of both provision and 
assessment. This means that a lot of training now has a more open-ended 

31 

L. Borghans etal.(eds.), Educational Innovation in Economics and Business V, 31 - 55 . 

© 2000 Kluwer Academic Publishers. Printed in the Netherlands. 



32 



Des Monk 



timeframe than it used to have; employees no longer have to attend a 
particular courses on a particular day of the week or attend a particular 
location in a specific month. 

Two central questions are raise by this paper. Firstly, the issue of why 
employers have sought to introduce new training methods is considered; 
secondly, an attempt at evaluation is made. To examine the first question, a 
distinction is made between push and pull factors. Although much of the 
policy-led literature has emphasized positive (or pull) reasons for the 
adoption of new training methods, the argument put forward in section six of 
the paper is that there are several powerful push factors at work; certainly 
that would appear to be the case in this case study. In other words, 
employers are often under pressure to consider changes in training because 
they are encountering more difficult circumstances in their product markets; 
changes in labor market conditions have followed changes in product market 
conditions. 

Attempts at evaluation are fraught with difficulties and some of these are 
discussed in sections 8 and 12 of the paper. However, it is the major 
contention of this paper that there has been something of a leap of faith, with 
respect to the adoption of new training methods. We do not really know if 
they are genuinely more efficient than traditional modes, even if senior 
management claim that they are, as they did in this particular case (Whitley 
& Martin, 1995). 



2. A FALSE DICHOTOMY? 

Obviously, it is possible to draw an overly stark distinction between 
“old” and “new” training methods. A distinction is made here for analytical 
purposes. One has to recognize that in practice, organizations have had, and 
will continue to have, a number of methods in use at any one time. Littlefield 
(1994) for example, rightly argues that it is difficult to be precise about the 
origins of open learning packages in the UK; one could suggest that they 
were the predecessors of correspondence courses that have been in existence 
for about a hundred years. However, it was the developments in computer 
technology in the 1980s and 1990s that really made open learning packages 
what they are today. Similarly, it is quite conceivable that a number of 
organizations had paternalistic figures who were in effect, unofficial 
mentors, in previous decades. 

Whilst one recognizes such a danger, of drawing distinctions that are 
overly stark, it does seem as though there is a consensus in the UK that there 
has been a (desirable) shift away from lecture-based, traditional, 
standardized, taught courses towards a new mentality that has emphasized 
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flexibility and the responsibility that an autonomous learner has for his/her 
own development (Mumford, 1985; Saggers, 1994; Torrrington & Hall, 
1995). 



3. HYPOTHESIS 

There has been a shift towards new training methods in the past decade in 
the past decade (or so). These methods have emphasized the need for 
flexibility and autonomy. Whilst such methods may have some intrinsic 
merit, they have frequently been adopted because employers have been faced 
with increasingly hostile product market conditions. As yet, we do not know 
whether they genuinely represent a more efficient use of those resources 
which have been committed to training. So far in the UK, there has been a 
great deal of optimism about these methods, and at least some of that 
optimism seems to be misplaced. 



4. TWO CAVEATS 

Firstly, UK employers’ training budgets were generally not cut in the 
1990s, despite difficult economic conditions (CBI, 1993; Saggers, 1994). 
Instead, there was a shift in emphasis such that a bigger proportion of costs 
were shouldered by the employee (DFE, 1992). 

Secondly, it is very difficult to gauge the effectiveness of training 
generally (Pickard, 1994) but that is especially so, given the open ended 
nature of the assessment procedures associated with new training methods. 
Many of the modularized programs on offer, and many distance learning 
packs, are considered attractive partly because there is a certain latitude 
allowed regarding the issue of student assessment. Students often can choose 
when they will sit an examination, or be tested for their competence in a 
particular area. The open ended time frames associated with modem training 
are, therefore, simultaneously an advantage to the trainee but an added 
source of methodological difficulties. It may be that a trainee has not 
undertaken any learning or assessment, for a long time in the context of a 
research project, but chooses to say that they will return to the program at a 
later date. However, traditional courses were often exa mi ned at a particular 
time and one could then see how many of a given cohort had passed or failed 
that test. 
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5. WHY THE SHIFT: SOME “PULL” REASONS 

As with many socio-economic phenomena, we might categorize the 
reasons for the shift towards the new training methods under two headings, 
i.e. positive (or “pull”) reasons and negative (or “push”) reasons. One 
important positive factor to explain the advent of new training methods is 
concerned with the widespread adoption of competence-based training. As 
Torrington and Hall (1995) point out, the development of competencies has 
forced employers to think very clearly about exactly what knowledge or core 
skills are needed to do ajob. Similarly, Armstrong (1995) and Fowler (1996) 
have suggested thatjob evaluation schemes are now increasingly likely to be 
amended by including competencies as a set of desirable characteristics that 
a person might bring to ajob. In the past, it was thought that such evaluation 
schemes were simply designed to assess the worth of one job, compared to 
another; as such, they were not designed to assess the worth of one candidate 
with respect to another. Now the UK has a framework of competence-based 
learning (the NVQ scheme) that can be used to assist in a variety of 
management functions, such recmitment and job evaluation, that can also be 
used to identify existing skills and help to think about staff development. 
Baron (1995) has also suggested that management should identify 
competencies as a means of thinking about interview questions. Certainly in 
the organization studied here (British Gas), senior management were quite 
clear that internal promotion interviews in the mid-1990s would be 
competence-based. In other words, the development of competence-based 
training has helped to bring training and general business objectives 
together. 

To explain the timing of the changes in training in the UK one could also 
point to the development of a national framework of accreditation (the NVQ 
system), that has only been in existence for about ten years (NCVQ, 1988). 
Prior to that, employees may well have been doing training that, potentially, 
might have been accredited but had to accept that such training was 
effectively firm specific, since it had not been graded according to the NVQ 
system. Clearly, such a lack of accreditation would effect an employees’ 
motivation to do training especially in their own time. Government 
departments such as the DFE (Department For Employment) were quick to 
point out that accreditation schemes also make it more likely that employees 
will take responsibility for their own development, since they are now more 
likely to be able to take such training to other employers and have it 
recognized (DFE, 1992). Whilst there may be some truth in this suggestion, 
one has to add the caveat that such an assertion has yet to be tested 
empirically; like much of the discussion on new training methods, it has yet 
to be demonstrated in any rigorous way. 
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This theme, of taking responsibility for one’s own development, is 
further taken up by two authors concerned with the training of nurses 
(Thome, 1991; Howard, 1993). In particular, Howard suggests that new 
training methods emphasize the role of andragogy, rather than pedagogy. 
Andragogy suggests that the learner is an autonomous adult who is able to 
take charge of their own development; part of this process means that the 
learner is able to “take stock” of their existing knowledge and then see where 
they want to enhance their portfolio of ski ll s, or competencies. This auditing 
process is a useful exercise in itself, as the learner has to gather together 
evidence of their skills, regardless of whether they were gained in a formal 
setting (such as a classroom) or an informal setting (for example, in having 
to learn about the demands of being a parent). Such a process, of 
emphasizing the learner’s role in their development, has been hastened 
because universities (especially the so-called “new universities in the UK) 
have had to develop ways and means of assessing such portfolios of 
evidence. Whilst a lot of work-based training can be accredited via the NVQ 
system, other competencies can be assessed by admissions tutors, in the light 
of their course requirements. 

Another characteristic of the new training methods is that they permit the 
learner to learn at their own speed. Just as one of the attractions of the Open 
University is that undergraduate courses are modularized and can be done 
over a period of time, so it said that open learning programs are similarly 
organized; people can learn at their own pace. Indeed, it is not only 
employers’ organizations who advocate such usage (such as the CBI, 1993), 
but also the employees’ representatives (such as the white-collar union 
UNISON, 1993). As UNISON rightly say, people have different 
commitments at different times and they also are able to absorb different 
skills at different rates, so once again, having open learning programs is 
deemed to be desirable but without any without any substantive evidence to 
back up this assertion. 

The final pull factor concerns the development of computer technology. 
Littlefield (1994) suggests that it was only in the 1980s and 1990s that PCs 
became substantially cheaper and much more widely available than 
computer technology had been until these decades. Such a development in 
technology explains, he argues, the rapid development of the Open College 
in the UK, who run courses in a fashion similar to the Open University, but 
at a lower academic level. Their estimate is that open learning has expanded 
at a rate of 20% per annum, since 1987. Such orders of magnitude are 
consistent with the increased take-up of open learning that Whitley and 
Martin (1995) envisaged within British Gas, during the 1990s. 
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6. WHY THE SHIFT: SOME PUSH REASONS 

However, one could also point to a number of push factors, to help to 
explain the development of these new training methods that put the matter in 
a different light. One critical factor to consider is the timing of such changes; 
surely one might expect that the sort of desirable (or pull) factors listed 
above would have been sought in previous decades. We therefore have to 
exa mi ne those factors which have been particularly relevant to the 1980s and 
1990s. In other words, another way of looking at the adoption of new 
training methods is that UK employers were compelled to reappraise their 
training strategies, with a view to getting a more efficient use of the 
resources concerned. 

If we consider the timing of these changes, it is striking that they are set 
against a backdrop of rapid globalization, with its attendant implications for 
increased competition in the product market place. Dunning (1996) points 
out that for the UK, stocks of outward foreign investment amounted to only 
14.5% of GDP in 1967, but by 1993 this had escalated to 26.9%. He also 
suggests that this growth in globalization has been especially rapid since the 
mid 1980s; whereas world-wide FDI outflows only grew by 0.8% per annum 
between 1981-1985, they grew by 28.3 % per annum from 1986-1990 and 
by 5.6% per annum, from 1991-1993. Similarly, Storey (1992) suggests that 
many organizations began a serious and concerted move towards more 
flexible management strategies from the 1980s onwards because, inter alia, 
they faced an increased threat from global competitors . Prior to that date, 
world trade may well have been growing but in the 1960s and 1970s, it was 
not thought to be sufficiently important to instigate a swing towards HRM 
strategies. Storey argues that the development of HRM in Britain is uneven 
but that nevertheless, many employers are having to consider such a policy 
shift because they face more threatening conditions in their product market 
place. This has meant that employees now have to contend with more 
flexible job descriptions, more flexible (and increasingly individualized) 
contracts and it has meant that training strategies have had to change. More 
and more employers in the UK are having to accept that they become 
learning companies, in Storey’s analysis; in his short article he does not 
explore this development in any depth but elsewhere (for example, Pedler et 
al, 1989), the supposition is that learning companies have to adapt 
themselves so that they are able to constantly learn new skills in order to 
compete. Such learning is often done on a flexible basis, because product 
market conditions demand such flexibility. A si mi lar point was made by 
Charles Munn at the EDINEB conference held in Edinburgh last year 
(1997). The UK banking industry has had to adopt flexible (open) learning 
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programs because the industry is now much more competitive than it was in 
the 1970s and earlier decades. 

From the employees’ perspective, it makes sense to accept these changes 
because they are, in effect, “buying” an insurance policy. As employees they 
might well want to have training done in the employers’ time at a set time 
each week, but they accept the decision to undertake flexible training even in 
their own time, because they face the threat of losing their jobs if they refuse 
an implicit contract whereby they do more than is spelt out in their formal 
job contract (Manning, 1990). Clearly, there may well be both push and pull 
factors at work at the same time, but it is striking that both the UK 
government’s publications (for example, the DFE 1992) and the 
management/practitioner literature (such as the CBI, 1993) has been 
noticeably enthusiastic about the alleged benefits of flexible training without 
much supporting evidence. One could equally well explain such 
developments by looking at push factors, in which case one might conclude 
that management were compelled to change their training methods. 

At least one reference in a management journal has accepted that product 
market conditions prompted a change in training policy (Whitley & Martin, 
1995). These authors were both senior training officers with British Gas and 
they accepted that exogenous changes had prompted a revision of training 
methods. In particular, they suggested that there was a need for more 
devolution when it came to training provision, because senior management 
had to accept that changed product market conditions warranted a less 
centralized training policy. The following quotations give one a “feel” for 
the sort of warm reception that was accorded to open learning: 

“Open learning is not cheap but it is certainly a cost-effective and flexible 
medium.” 

“Currently around 16 per cent of our training is delivered through open 
learning ... In three years time we expect that 80 per cent of our training 
will be done through some form of open or flexible learning.” (Whitley 
& Martin, 1995). 

Whitley and Martin suggested that a changed culture had necessitated a 
new training policy that was much more devolved than had previously been 
the case. This devolution had partly been bought about because the company 
had undergone a far reaching business process reengineering program (see 
section 7 below). The company had been reorganized along functional 
(rather than regional) lines and there were to be four major sections of the 
company’s actives in the UK; the most important of these was concerned 
with the transmission of natural gas along a high pressure pipeline, Transco. 
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An internal communication within Transco had this to say about new 
training methods: 

“New technology has made it possible for self-study material to be sent 
through Transco’ s computer network ... The benefits to shippers and 
Transco staff are the provision of immediate, up-to-date training- no 
having to wait for classes large enough to justify running a course.” 
(British Gas, Transco, 1995) 

What Whitley and Martin did not make explicit was the extent to which 
the company had its profits severely curtailed in the 1990s. Of course, there 
are a number of ways to measure profit, but in this case the different 
measures correlate reasonably well. The most common way to measure 
profit that was used within the company was after tax, and using a current 
estimate of the value of the gas used (rather than a historical) one. This 
procedure was slightly amended in 1997, when the accounts were drawn up 
on a historic-cost basis i.e. taking the value of the gas used at the time of 
purchase rather than the end of the financial year. It is also worth noting that 
1997 was the first year that completely separate accounts had been drawn up 
for the two major wings of what was British Gas; from 1997 (see section 7 
below) the trans mi ssion wing became a company called BG , whilst the 
trading arm became another organization called Centrica. In table 1, the 
estimate of profits for 1997 represents the amalgam of both of these new 
companies. 



Table 1. British Gas’s profits at nominal prices (in millions £) 



Year 


1987 


1988 


1989 


1990 


1991 


1992 


1993 


1994 


1995 


1996 


1997 


Profit 


1067 


1018 


1065 


1063 


1469 


846 


-613 


918 


607 


-237 


1251 



Source: Annual Report (British Gas, various years) 



The way that British Gas calculated its profits was itself a source of 
controversy; the company had a vested interest in showing its monopoly rent 
to be as low as possible. Critics pointed out that relations between the 
organization and its regulator (OFGAS) were frequently strained (Weston, 
1996) and the level of profits was an obvious source of tension. It was to the 
company’s advantage to show profits to be relatively low, as part of the 
battle over recommended pricing levels set by the regulator. The fact that a 
loss was recorded for 1993 was directly as a result of the company putting 
aside some £1.6 billion for the purposes of reorganization. It intended to 
spend that money over a three-year period (1994-1997) and if those costs 
were to be shown in the years concerned, then a surplus would have been 
recorded for 1993. Broadly speaking, however, one can accept that the profit 
levels indicated reflect the extent to which the company enjoyed a 
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producer’s surplus. Given that this is the case, it is quite clear that 
immediately after privatization (in 1986) the company still enjoyed a degree 
of monopoly rent; profits were consistently above the £1000 level until 
1991. Indeed, within the company there was a certain degree of complacency 
regarding the commercial implications of privatization. The CEO (Cedric 
Brown) referred in 1994, to “ the privatization that never was”, meaning that 
the way that the company was run was very similar to the way that it had 
been run prior to privatization, a point also made by Femer and Colling 
(1991). The important point here is that whilst they were a nationalized 
industry (and shortly afterwards), British Gas enjoyed a degree of producer’s 
surplus and this extended to its provision of training, i.e. the company could 
afford to offer general training to its employees in office hours. As product 
market conditions tightened, the company sought to use more cost effective 
training (i.e. adopt new training methods), as Whitley and Martin indicated. 
In adopting this policy though, management within the company seemed to 
have underestimated the pitfalls involved. 



7. THE INSTITUTIONAL BACKGROUND 

In order to understand events in this study, it is necessary to outline the 
connection between the product and labor markets and this in turn makes it 
necessary to briefly outline the institutional history of the organization. 
Broadly speaking the 1980s were characterized by a limited degree of 
change, whereas the 1990s were characterized by a need for a more radical 
response to rapid exogenous change. 

The UK Labor government established a number of nationalized 
industries in the late 1940s; the Gas Board (the predecessor to British Gas) 
was established in 1948. For the next four decades it enjoyed a considerable 
degree of market power; not only did British Gas enjoy pure monopoly 
power in the UK domestic market, but it also enjoyed monopsony power in 
the factor market for natural gas, from the mid-1970s. Although the 
organization was privatized in 1986, this did little to alter their market power 
as the legislative provision for third party carriage was not rea li zed in that 
decade. 

In the early 1990s the concern felt at the ex-nationalized industries’ 
market power resulted in the adoption of Professor Littlechild’s RPI-x 
formula in a number of cases. The formula was imposed on British Gas from 
1991 onwards and is largely felt to have accounted for the fact that profit 
figures in the 1990s have not matched those of the 1980s (see section 6 
above). Currently the trading wing of what was British Gas have to accept a 
pricing policy that is geared to an x figure of 4%. In real terms, of course, the 
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cost of gas to the British householder has been falling for most of the 1990s. 
The equivalent figure for the transmission wing is 2%. 

In 1993, the company was the subject of the biggest single reference to 
the MMC, (the Monopolies and Mergers Commission, the UK’s anti-trust 
body). The Commission expressed renewed concern that British Gas was, 
simultaneously, an organization responsible for the transmission of gas 
around the UK, and one of a number of actual (and intended) shippers, 
responsible for selling gas direct to industrial and domestic consumers. By 
the early 1990s, the company’s monopoly position had been breached in the 
industrial market but not in the domestic market for Britain’s 18 million 
households. The company was to make arrangements to ensure that there 
would be competition in its core market, by publishing the prices that it 
would charge to consumers in advance and by splitting up the organization 
in order to prevent cross subsidy, in particular to prevent a situation whereby 
the transmission wing subsidized the trading wing. The company announced 
plans whereby it would shed a third of its workforce, some 25,000 
employees, over a five year period. 

In 1994, the company started the business process reengineering that was 
necessary as a prelude to the increased competition that it was likely to feel 
in its core (UK) market, the market for natural gas, sold to the nation’s 18 
million households. The organization abandoned its 12 regional centers, in 
favor of four functional units; of those, the most important were the 
transmission wing (Transco) and the trading wing. The monopoly power of 
Transco was confirmed by the Gas Act of 1995; only Transco was able to 
legitimately transmit gas along pipelines in the UK to customers. By the 
following year (1996), it was quite clear that a number of competitors were 
interested in entering the domestic trading market, as several independent 
shippers began to supply households in the south-west of the country in a 
pilot scheme that has since been extended to the whole of the UK. 

Two major events occurred in 1997. Firstly, in February the transmission 
wing (now called BG) became a completely separate company with its own 
stock market listing, distinct from the trading wing (now called Centrica). 
Secondly, the hostility between the industry and its regulators continued with 
yet another reference to the MMC; this time, the problem centered on the 
pricing strategy that the transmission wing was to be allowed. The MMC 
confirmed OFGAS’s (the industry watchdog’s) suggestion that the prices 
charged by BG to the shippers should be pegged at RPI-2% for five years 
with a one-off fall of 21% that was imposed from October of that year. 

The important point to be made in this section is that the exogenous 
changes faced by British Gas especially in the 1990s, brought about changes 
to their HRM policy. Arrangements for the provision of training within the 
company’s internal labor market were critically affected by the 



New Training Methods 



41 



government’s (increasingly intrusive) regulatory policy. The argument in 
this paper is that senior management may well have thought that their 
strategy represented a rational response to such exogenous change, but they 
seemed to have underestimated the difficulties of using modem training 
methods. 



8. METHODOLOGY: BRITISH GAS AS A CASE 
STUDY 

To test the hypothesis outlined in section 3 it was felt that a case study 
methodology would be appropriate. Of course, there are obvious problems 
with such an approach; one is never sure whether the results are genuinely 
applicable, or not. At the very least, one can be sure that as a single entity, 
British Gas was one of the UK’s key industries and therefore an important 
institution in its own right. It has been the biggest of the UK’s (well- 
publicized) privatization ventures. It also had some 90,000 employees in 
1986 (at the time of privatization), which made it one of the top ten 
employers. Moreover, like a number of other companies in the UK, it felt 
that the UK market was becoming increasingly saturated by the late 1980s 
and thus sought to extend its activities abroad. Again, like many other 
companies it sought to delayer its management structure in the 1990s; from 
having 14 different white collar grades in 1986, its successors (BG and 
Centrica) now have 10 such grades. Finally, like a number of companies 
(Saggers, 1994; King, 1993) British Gas did not reduce its training budgets 
in the 1990s; instead, it sought to alter the distribution of costs and put more 
emphasis on employees bearing the (indirect) costs of training , in terms of 
using their own time. In short, there are a number of reasons to suppose that 
British Gas represented an important case study that was illustrative of a 
number of trends in British industry in the 1990s. 

British Gas was also chosen because it was so clearly in favor of the use 
of those modem training methods which have been outlined in the first 
section. Whitley and Martin, as two of the senior training officers within the 
organization had attested (in 1995) to the fact that the company were 
committed to the use of open learning centers. Moreover, the company were 
also committed to the concept of competence-based training and as such, 
made sure that they were able to independently assess the full range of NVQ 
competencies up to and including level four; the fifth (highest) level was the 
only one that required them to use external assessors. In common with the 
sort of developments described by Mumford (1985), British Gas had gone to 
some lengths to make sure that their graduate trainees were aware of the 
need to be responsible for their own development. The organization were 
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also keen to move away from a culture that equated training with courses 
and as such, they were in favor of using mentors and in-house appraisals 
(British Gas, 1994). 

To test the sort of assertion outlined in section 3 it was felt necessary to 
track a cohort of graduates over a number of years. In this case, that meant 
interviewing 30 graduates who had started on the company’s GDP (graduate 
development program) in 1993. Actually, the company had recruited 70 
graduates in 1993, but by the time access was gained to the group (in 1994), 
there were 60 graduates who were still with the company; of those, 53 
agreed to complete a questionnaire and 38 (of these 53) agreed to be tracked. 
Of the 38 people who agreed to be tracked, 8 replies were discarded for 
logistical reasons (for example, because they were working in very distant 
locations). 



9. METHODOLOGY: THE NATURE OF THE 
COHORT 

In view of the sort of hypothesis being tested, it is worth saying 
something about the employees concerned. After all, if training policies are 
not as effective as management might wish for, then presumably one might 
say that this could be attributed to the sort of recruit into the organization. In 
this case, the company had grounds for believing that the employees 
concerned had already demonstrated a successful capacity for absorbing new 
information. They all had an honours degree from a British university. 
Moreover, they were working for an organization that had gone on record to 
confirm their commitment to the strategy of having its graduates 
professionally qualified (British Gas, 1994). This meant for example, that the 
organization was prepared to pay the fees required to sit exa mi nations and 
give time off, for study purposes. The graduates had an incentive to train 
successfully, in that they were to be appraised (by their line manger) every 
six months and if that appraisal was adjudged to be successful, then the 
graduates were to receive an increment of £1,000, plus, of course, the 
possibility of extra career advancement. The majority were resigned to the 
idea of using their own time for training purposes; in the questionnaire 
replies 37/53 agreed with the statement that the company expected them to 
use their time for training. In short, we might expect on a priori grounds, that 
this case study would provide both an employer and a set of employees who 
would make the most of the new training methods available to them. 
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10. RESULTS 

In terms of attrition, the 30 graduates interviewed in the autumn 1994 
were reduced to 28 by the following year and they were further reduced 
down to 21 by the autumn of 1996. Of these quits, only three took voluntary 
redundancy, despite the fact that it (voluntary redundancy) was the major 
means by which the company shed the third of its employees referred to in 
section 7. Predictably, most (7/9) of the graduates that left did so in order to 
take up anotherjob offer; one graduate was able to take up anotherjob offer 
and also collect his £9000 lump sum for voluntary redundancy (worth 
approximately half of his salary). 

Despite the fact that the company actively encouraged the graduates to 
become professionally qualified, a surprising number did not do so; after all, 
by refusing to become so qualified they were considerably reducing their 
chance of gaining extra salary and promotion either within, or outside of, 
British Gas. Of the group of 30 graduates described earlier, who were 
tracked, only 18 became “active joiners.” Six graduates said that they had no 
intention of being professionally qualified and a further six were “other 
joiners”, i.e. people who were able to claim professional status by virtue of a 
previous qualification (in 4/6 such cases this was by virtue of a Ph.D. and in 
the other two because of an MSc.). This clearly calls into question the extent 
to which graduates felt compelled to take responsibility to ensure that they 
met a target set for them by the company. Those who already had 
professional status could have indicated their ability (and willingness) to 
learn new skills in their own time by studying for another relevant 
qualification, such as the Open University’s Certificate in Management 
Studies; being seen as an “active joiner” would have considerably increased 
their chance of gaining early promotion. 

In 1996 the graduates were asked to evaluate the GDP; they all said that 
it was too long and the consensus was that a year would have been long 
enough. Of those interviewed at the end of their training period in 1995, 10 
graduates had been promoted and all these came from the active joiner 
group. However, the promotion interviews that were held in 1995 and 1996 
were competence-based. Several graduates said that it was therefore even 
more imperative that the objectives of their GDP should have been spelt out 
in competence terms, which they were not. 

From a policy perspective, these results were interesting in that none of 
the graduates concerned were aiming for the NVQ scheme outlined earlier. 
Of the 30 graduates who were tracked, 1 8 were aiming for membership of a 
professional body such as the I.Mech.Eng. (the Institute for Mechanical 
Engineering) or CIMA (the Chartered Institute for Management 
Accountants; such membership applications usually meant having do 
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demonstrate certain abilities by means of examination or by a range of 
practical tasks that were assessed Such professional status was felt to be a 
more useful means of signaling aspiration or ambition, than the NVQ 
system. 

A third of all of the appraisal interviews that should have been done were 
not done. Bearing in mind that these interviews should have been the basis 
on which increments of a £1,000 were given (or withheld), then this was a 
surprising result. In fact, none of the graduates had their increment withheld; 
the money was simply paid, regardless of performance. 



11. WHY WERE THE NEW TRAINING METHODS 
UNSUCCESSFUL? 

One obvious question to emerge from this research concerns the reasons 
for the lack of success associated with new training methods. Open and 
distance learning programs were only used by 17/30 of the graduates who 
were initially tracked and were only considered useful by 6/28 of those 
graduates who were still in the survey a year later; see appendix two. Despite 
assurances by senior management that over 80% of training would be carried 
out via open learning (Whitley & Martin, 1995), those who were charged 
with the task of running open learning centers estimated that usage rates 
were low and running at no more than 20% (of the available time) and this is 
almost certainly an optimistic estimate. Similarly, appraisal interviews were 
the mechanism by which competencies should have been assessed and yet 
over a third (11/30) of the interviews that should have been done at the end 
of the first year of the training program had not been carried out; see 
appendix three. The company’s own guide to the graduate training program 
stated quite clearly that graduates were expected to use at least some of their 
own time to become professionally qualified (see British Gas, 1994; 1995). 
However a significant minority (12/30) made it clear that their had no 
intention of pursuing this strategy. In six cases graduates argued that they 
had already achieved such status by virtue of a previous qualification 
(usually a Ph.D.), and in six cases employees simply stated that they had no 
wish to join a professional body. By the end of the three-year tracking 
period, all of the graduates had abandoned attempts to keep in touch with 
their mentors. 

Three plausible reasons to explain these developments come out of the 
literature on the economics of education/training. The first useful starting 
point would be the distinction between the consumption and investment 
benefits associated with education/training. A number of textbook authors 
(such as Atkinson, 1983), have distinguished between the immediate short 
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term gains to education (consumption benefit) and a longer term stream of 
benefits that would accrue to the person undertaking various courses (the 
investment benefit). Most of the graduates surveyed here were quite clear 
that they regarded training as a means of furthering their career; they were 
interested in the investment returns to training. Of the 53 questionnaire 
replies received, the vast majority (38) agreed that the major motivation for 
doing training was the extra earnings that could result in the future; see 
appendix four. Indeed, in many of the interviews, it emerged that these 
employees did not enjoy doing the courses that they were expected to do; 
there was little evidence of consumption benefit. The evidence suggests that 
these core employees were prepared to spend at least some of their own time 
in training; see appendix four, where it emerges that only two (out of 53) 
thought that they were expected to use an unreasonable amount of their own 
time in training. However, from the employees’ perspective the rationale for 
using such time was as a means to an end, i.e. getting extra earnings in the 
long run. The perceived benefits of training were in investment, rather than 
consumption terms. Indeed, all five of the Ph.D. graduates claimed that they 
were very interested in the scientific nature of the work that they were 
employed to do. They claimed that they did not want to get promoted if such 
promotion would take them away from the specialist work that they were 
interested in. If graduates were not especially interested in promotion, then it 
may have been quite a rational policy not to use their own time to study for 
professional status. 

Of the 30 graduates who were tracked in this study, twelve had no 
interest in using their own time to become professionally qualified. It is true 
that this meant that they were significantly less likely to get promoted (see 
appendix 5), but this trade-off may have been considered as a price worth 
paying, given that the training methods outlined above provided little or no 
consumption benefit and were predicated on the basis that they were 
sufficiently flexible that they could be used in the graduates’ own time. 

A second contribution from the economics of education literature comes 
in the form of the debate surrounding the screening (or credentialism) 
hypothesis. Arrow (1974 ) and others (Adnett, 1989), have suggested that 
employers and employees may well wish to use education/training 
qualifications as a means of sending (or receiving) signals. These signals 
may be used as proxy measures for what Blaug (1993) describes as desirable 
employment characteristics such as future “trainability”, the ability to 
organize ones’ efforts, or even more general traits such as politeness. The 
starting point for the hypothesis is that to accurately measure productivity or 
to gather reliable information about candidates is expensive and fraught with 
difficulties. Employers therefore wish to save on transactions costs and use 
qualifications as a readily available sifting device to weed out those 
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applications that they do wish to consider any further. The more relevant 
signals that employees have, the more likely it is that employers are prepared 
to offer them a desirable job. This signaling process applies both to 
applicants for an initial port of entry job, as well as internal applicants who 
wish for a promotion post. There has been little by way of empirical 
evidence to support (or refute), this signaling hypothesis. Shah (1985) 
provides some “tentative” evidence to support the hypothesis, using British 
data. However, Shah’s work was concerned with pre-entry screening; the 
evidence here suggests that post-entry credentialism has occurred. Graduates 
regarded the pursuit of professional status as the best means of sending out 
signals in the internal labor market. They were less concerned with the 
government’s NVQ scheme, or maintaining links with their mentors, 
because these strategies were not seen as efficient means of sending out 
relevant signals. Ironically, many graduates regarded their progress whilst 
doing these exa mi nations with some apprehension. Of the 18 graduates 
aiming for professional membership in the second round of the study, 8 of 
them said that they thought that this application was going badly. However, 
5/8 of these employees still managed to gain promotion that year. The 
process of getting professional status seemed to be used as a means of 
sending out signals that implied that these graduates were ambitious and well 
organized, and as such, were prime candidates for promotion within the 
internal labor market. In pursuing this strategy, graduates were not overly 
concerned with the use of the new training methods alluded to earlier. The 
important that they wished to establish, within the company, was that they 
had the sort of desirable characteristics mentioned earlier, that would be 
sought after by managers who were about to decide who should be given 
promotion. The ambitious graduates’ determination to become active joiners 
(of professional bodies) was the key element of their strategy; how they 
achieved this end was of less significance to them. As a consequence, some 
of these graduates signed up for evening classes, which one might regard as 
a traditional mode of learning; others simply took out books from local 
libraries to help them to pass their exa mi nations. Very few of the graduates 
in this study fond that open learning programs were useful; in fact only 6/28 
did so, in the second round of the study. 

Thirdly, in economics the principal-agent has been recognized as having 
an important bearing on many different types of transaction, including the 
provision of education or training (Elliott, 1991). In this context, British Gas 
HQ may be thought of as the principal (the policy maker). It was this central 
body that considered the use of the new training methods as constituting an 
important part of future policy (See Martin & Whitley, 1995). The agents 
left to carry out the policy were the local managers, who had a number of 
other responsibilities apart from the development of those graduate trainees 
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that happened to be working for them. These local managers had different 
agendas from the principals. Many managers felt that they, as individuals, 
were gaining little benefit from giving staff appraisals that were designed to 
assess the competencies gained by their graduate trainees. This distinction 
(between local management and British Gas HQ), is echoed in other 
organizations and the principal-agent goes some way towards explaining 
why competencies were not adequately monitored. Moreover, this finding 
fits into a more general context that is described in appendix four; the 
majority (27/53) of the graduates surveyed agreed that British Gas was 
insufficiently willing to assess the benefits of the training that were given. 
Indeed, 80% of the senior managers of one region of the company agreed 
that although the company was willing to devote resources to training, it was 
insufficiently willing to evaluate the effectiveness of such policies (British 
Gas West Midlands, 1993). The graduates surveyed here may well have 
gained extra competencies but in many cases there was little enthusiasm on 
the part of local managers to accurately monitor such developments. Of 
those appraisal interviews that did take place, nearly a quarter were dealt 
with in a summary fashion. The decision to award, or potentially withhold, a 
£1000 increment was made in a period of under 30 minutes, in 7/30 cases. 

Two further explanations seem plausible, which are not from the 
economics of education literature. Firstly, the organizational flux suffered by 
the company has been described in section 7. The key point here is that such 
flux meant that mentors were often difficult to track down; as a consequence, 
graduates became disillusioned with the mentoring system. Moreover, many 
of the mentors were senior mangers who were quick to take advantage of the 
enhanced pension schemes, or voluntary redundancy being offered by the 
company, when it had to shed a third of its workforce in a five year period. 
Although, potentially, such mentors had skills and knowledge that could be 
passed on to their charges, in practice, the system fell into disuse quite 
quickly. 

Finally, the relevant timeframe within which assessment could be carried 
out is an important consideration. Shackleton (1995) rightly argues that one 
of the very advantages of new training methods (i.e. open timeframes) is, 
simultaneously, a source of difficulty. With traditional off the job courses, a 
formal examination is frequently held (at a set time), to determine how well 
students have mastered the material. In the case of many new training 
schemes, such assessment does not occur in this fashion. Thus, those four 
graduates who took out open learning programs for modem languages (at the 
start of the training in 1993/4), all agreed (in 1996), that they were unlikely 
to finish them. Of course, the problem here is that it becomes very difficult 
to say exactly when the attrition occurred. The graduates concerned said that 
they thought that they might go back to their studies, at some (unspecified) 
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point in the future. The lack of a fixed timetable for assessment may well 
have accounted for some of the “slippage” experienced here. 



12. CONCLUSION 

One has to be especially circumspect when suggesting any conclusions at 
the end of a study such as this. It is, after all, only one case study that 
featured one organization in the UK, and involved using a relatively small 
sample of questionnaire replies (53) and meant tracking an even smaller set 
of (30) graduates over a three year period. Clearly, one would have had more 
confidence in the results if they had measured the replies of thousands of 
people, over a longer period of time. It is also true that questionnaire replies 
suffer from the obvious defect that respondents are not responsible for their 
replies and they might well not be replying in a truthful manner. More 
research needs to be done. However, it is striking that a number of claims 
have been made about the benefits of modem training methods, in the 
practitioner/policy literature alluded to earlier, without supporting evidence. 
If these (alleged) benefits are to be assessed, then some sort of longitudinal 
study, done within one (or more ) institutions would seem to offer a suitable 
means of evaluation. 

It seems clear that there may well be a number of advantages to modem 
training methods (as described in section 5). However, to account for their 
adoption in the UK we also have to examine the sort of “push” factors 
outlined in section 6; certainly in this case as Whitley and Martin admit, the 
link between the product and labor markets is an important one. Economic 
necessity drove employers to consider fresh ways of gaining what they 
perceived to be a more efficient use of training budgets. In adopting a 
strategy that seemed rational, they seemed to have underestimated the sorts 
of difficulties that were involved and that were described in the last section 
(10). 

We need to treat allegations of the merit associated with modem training 
methods very circumspectly. In the study here British Gas chose their 
graduates with great care; each one cost some £9,0000 transactions costs at 
the point of entry (British Gas, 1995). The point was made in section 9 that 
one might have imagined that the graduate employees in this study would 
succeed, given their previous track record and the fact that they had a 
number of (a priori) reasons for wanting to do well in their GDP. In fact the 
results of this study are distinctly mixed, from a management perspective. 
Given that British Gas was still spending some £35 million on the direct 
costs of training alone and given the attrition rates outlined earlier, then the 
case for swapping over to modern training methods is far from convincing. 
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Finally, one has to say that in this case the organization, whilst being 
committed to training, was even by its own admission, not sufficiently 
willing to evaluate the huge outlays involved. In a 1993 internal study, 80% 
of senior management thought that a former region (West Midlands Gas) did 
not sufficiently evaluate the money spent on training and that is certainly 
consistent with the evidence gleaned in this study. In that sense, it does seem 
as though the considerable sums that have been devoted to modem training 
methods represent a leap of faith. 



APPENDIX 1 TRAINING WAS A KEY CONCERN 
OF THE GRADUATES AND WAS READILY 
AVAILABLE 



Table la. My reason for staying with British Gas was 



Reason for staying with B.G. 


Frequency 


Percentage 


Cumulativ 


2 


8 


26.7% 


26.7% 


3 


1 


3.3% 


30.0% 


4 


14 


46.7% 


76.7% 


5 


2 


6.7% 


83.3% 


6 


4 


13.3% 


96.7 


7 


1 


3.3% 


100.0% 


Total 


30 


100.0% 





Key: 

Code Reason 

1 Seniority Rights 

2 Nature ofthe work 

3 Pay 

4 Training 

5 State of the Labor Market 

6 Other 

7 Pay back relocation expenses 

NB This data was from the first round of the longitudinal study, i.e. collected in the autumn of 
1994. 



Table lb. How easy/difficult, in the past year, has it been to make sure that you get the 
training that you want? 





VERY EASY 


EASY 


NEUTRAL 


DIFFICULT 


VERY DIFFICULT 




10 


11 


1 


5 


1 



NB This data was from the second round of the longitudinal study, i.e. collected in the autumn 
of 1995. 
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Table lc. How easy/difficult has it been to get any training you may have wanted, this past 
year? 





VERY EASY 


EASY 


NEUTRAL 


DIFFICULT 


VERY DIFFICULT 




5 


9 


1 


2 


4 



NB This data was from the third round of the longitudinal study, i.e. collected in the autumn 



of 1996. 



APPENDIX 2: OPEN/DISTANCE LEARNING 
PACKAGES WERE USED BUT WERE NOT 
CONSIDERED VERY USEFUL 



Table 2a. Have you used any open learning packages 



OPEN LEARNING PACKAGES 


Frequency 


Percentage 


Cumulativ 


+ 


17 


56.7% 


56.7% 


- 


13 


43.3% 


100.0% 


Total 


30 


100.0% 





Key: 

Code Open learning packages 

+ Yes 

No 

NB This data was from the first round of the longitudinal study, i.e. collected in the autumn of 
1994 . 



Table 2b. How useful did you find any open/distance learning materials? 





VERY 

USEFULL 


USEFULL 


NEUTRAL 


VERY 

LITTLE USE 


COMPLETELY 

USELESS 




2 


4 


2 


2 


18 



NB This data was from the second round of the longitudinal study, i.e. collected in the autumn 
of 1995. 



Table 2c. How useful have you found open/distance learning materials ? 





VERY 

USEFULL 


USEFULL 


NEUTRAL 


NOT 

USEFULL 


NOT AT ALL 
USEFULL 


N/A 




0 


5 


1 


1 


3 


11 



NB This data was from the third round of the longitudinal study, i.e. collected in the autumn 
of 1996. 
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APPENDIX 3: STAFF APPRAISALS 



Table 3a. Have you had two staff appraisals? 



STAFF APPRAISALS 


Frequency 


Percentage 


Cumulativ 


+ 


19 


63.3% 


63.3% 


- 


11 


36.7% 


100.0% 


Total 


30 


100.0% 





Key: 

Code Staff Appraisals 

+ Yes 

No 



Table 3b. How long did your staff appraisals last on average? 



STAFF APPRAISAL LENGTH 


Frequency 


Percentage 


Cumulativ 


1 


6 


20.0% 


20.0% 


2 


1 


3.3% 


23.3% 


3 


0 


0% 


0% 


4 


22 


73.3% 


96.7% 


5 


1 


3.3% 


100.0% 


Total 


30 


100.0% 





Key: 

Code Staff Appraisal length 

1 0 Minutes 

2 Under 30 Minutes 

3 Between 30 Minutes to 1 Hour 

4 Between 1 to 2 Hours 

5 Over 2 Hours 

NB This data was from the first round of the longitudinal study, i.e. collected in the autumn of 
1994 
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APPENDIX 4: RESPONSES TO ATTITUDINAL 
SURVEY 



Table 4. 





STRONGLY 

AGREE 


AGREE 


NEUTRAL 


DISAGREE 


STRONGLY 

DISAGREE 


Cl 


1 


1 


5 


31 


15 


C2 


12 


33 


3 


5 


0 


C3 


3 


24 


16 


9 


1 


C4 


3 


28 


15 


6 


1 


C5 


0 


10 


6 


24 


13 


C6 


6 


32 


6 


7 


2 


C7 


31 


21 


1 


0 


0 


C8 


10 


35 


5 


2 


1 


C9 


1 


14 


10 


20 


8 


CIO 


3 


14 


10 


20 


8 


Cll 


3 


4 


10 


31 


5 


C12 


1 


7 


6 


33 


6 


C13 


0 


7 


32 


13 


1 


C14 


5 


18 


14 


15 


1 


C15 


5 


27 


9 


9 


3 



Section C Questions 

1) The amount of my own time that I have to invest in training is unreasonable. 

2) The training that I receive is sufficiently general as to be applicable in a range of 
organizations. 

3 ) British Gas is sufficiently willing to assess the benefits of my training. 

4 ) British Gas is sufficiently willing to assess the costs of my training. 

5 ) The major motivation for training is the extra salary it is likely to generate in the 
short run (i.e. within the next two years). 

6) The major motivation for training is the extra salary it is likely to generate in the 
longer ran. 

7) The major motivation for training is to enhance my long term career prospects. 

8) British Gas is committed to training. 

9) Far too much of my time at work is spent doing menial tasks that are not 
commensurate with my position in the company. 

10 ) My long term career aim is to stay with British Gas and get a senior managerial post. 

ID In order to achieve a full range of competences I am obliged to change locations 

more often than I would wish. 

12) In order to achieve a full range of competences I am obliged to change jobs more 
often than I would wish. 

13 ) The main company rationale for on-the-job training is the chance that it gives British 
Gas to disseminate company values. 

14 ) The company expects me to use my own time to gain extra competences as part of 
my development. 

15 ) I feel that I have been fairly treated by the staff appraisal system in the way that my 
training needs have been assessed. 

NB This data was collected from the 53 questionnaire replies received in the autumn of 1994. 
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APPENDIX 5: CROSS TABULATION OF 
MEMBERSHIP OF A PROFESSIONAL BODY 
AND PROMOTION (CHI-SQUARED TEST) 





Promotion 




Total 




Yes 


No 




Membership of a Professional 
body 








1 


0 


1 


1 


2 


5 


2 


7 


4 


2 


3 


5 


5 


3 


2 


5 


n 


0 


10 


10 


Total 


10 


18 


28 



NB The data above is from the second round of the longitudinal study, i.e. collected in the 
autumn of 1995. 



Key: 

Code Application Status 

1 Getting on very badly with application tojoin 
professional body. 

2 Getting on badly with application tojoin professional 
body. 

4 Getting on well with application tojoin professional 
body. 

5 Getting on very well with application tojoin 
professional body. 

n Not currently applying tojoin professional body. 

The expected value in a number of cells is less than 5. Chi-squared test is not valid. 

Chi-square =11.32, Degrees of freedom=4, p value = 0.02314980 

In the absence of the problem discussed above, one would be inclined to hold the HI 
hypothesis (i.e. accept that there was some relationship between the variables) and reject HO 
(the null hypothesis). If one collapses some of the cells together so that rows 1/2/4/5 are 
combined and compared to row n, then the cell values do, of course, become higher. 
However, in this situation, there is one degree of freedom and there is still one cell with an 
expected value of less than 5; the problem is not resolved. 
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1. INTRODUCTION 

The aim of this paper is to present a model of an organization as a 
learning system drawn from organization theory and to enhance this with 
models of learning which are becoming increasingly prominent in 
economics. We find that the two paradigms have the potential to enrich each 
other’s understanding of the same topic. We then consider two implications 
of this for the organization of learning within the business school world: 
first, for the role of the business school in partnership with corporate clients 
which are assumed to be “learning organizations,” and second, we consider 
the impact upon the nature of the economics curriculum within MBA 
programs. 

Our analysis develops further the thinking behind Nellis (1998) and 
reflects how the pedagogic and research concerns outlined in that paper have 
progressed. Nellis suggests that a crisis grips academic economists in the UK 
and emphasizes that: “ ... there is now a growing question concerning not 
only the role of economics but about the future of economics education.” 
(Nellis, 1998). Further evidence to support this view is not hard to find. In 
particular, enrolments to study single honours economics degrees in British 
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universities have been falling steadily for many years. Along with this, there 
is a growing realization amongst British academics that the average ‘quality’ 
of undergraduate and graduate students is declining. Furthermore, the role of 
economics within the growing market of vocationally relevant business 
degrees is being questioned quite sharply - as evidenced by the fact that 
economics is taught as a discrete subject on only a very small minority of 
MBA programs within the UK. 

In addressing this ‘crisis’ facing the academic econo mi sts we examine 
whether the gap between economic theory and business practice has been 
overstated, and whether economists have been serving their subject as well 
as they might by failing to realize the potential value and excitement to be 
had in teaching more directly a curriculum which reflects current research in 
the subject. As an example of this we track two apparently unconnected 
phenomena: first, the development of learning as an important theoretical 
concern for organizational theorists (see Grant & Spender, 1996; Adler & 
Cole, 1993; Adler, 1992; and Tsoukas, 1994); and secondly, the recent 
development of interest in learning within economics (see Marimon, 1997; 
Borgers, 1996). We assert that economic theories of learning are rarely 
presented to managers and that this failing overemphasizes the perceived 
irrelevance of economics which many managers and students feel as they 
approach the subject. 1 

The argument of this paper proceeds as follows. In Section 2 we present a 
brief overview of organizational learning which reflects the character of 
recent work in organization theory. The principle feature of such models is 
that they are non-economic: they describe how learning takes place, and 
relate it to causal factors using systems theoretic frameworks, or to 
metaphors drawn from psychology. These models of learning are incomplete 
in that they fail to address learning in an economic context, and thus in 
Section 3 we present a summary of the economics of learning. Sections 2 
and 3, taken together, amount to a more general theory of learning, 
describing both how (Section 2) and why (Section 3) learning comes about. 
Section 4 then draws some implications from this theory of organizational 
learning to develop some conceptual frameworks for how Business Schools 
might view relationships with their ‘clients’. Our key ideas for educational 
innovation are presented in this section: namely the concept of a learning 

'Consider for instance the role of game theory in the New Industrial Organisation which has 
hardly touched the way economic principles courses are taught. In addition, models of 
public choice have greatly enriched what we understand about regulation of business. The 
economics of development has a great deal to say about normative and ethical matters of 
great relevance to business. The new theories of growth are very rich in matters which 
could only be described as sociological and new trade theories are steeped in realities of 
political behaviour. 
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partnership and the notion of a learning organization. Section 5 gives an 
illustrative example of how these innovations affect one aspect of the work 
of a Business School, specifically the economics curriculum. 



2. THE ORGANISATION AS A LEARNING 
SYSTEM 

Learning is becoming more important: organizations need to leam 
(adapt) in order to survive and the rate of change of market and non-market 
(e.g. regulatory) environments is now so fast that the importance of learning 
is rising up the hierarchy of key competencies of most (but unfortunately not 
all) organizations. An extreme view of this strategic imperative towards the 
learning organization is presented by Quinn et al (1990) who assert that the 
firm is best viewed as an ‘intellectual entity’ and that products are simply the 
results of the film’s knowledge resources. This is consistent with a well- 
established vein of economic reasoning within Industrial Organization 
Theory and associated with Schumpeter (1954) and Penrose (1959). 
Schumpeter sees the essence of competition to be related to innovation, a 
struggling for intellectual leadership between ever more knowledge- 
intensive businesses. Penrose, who has become fashionable with strategy 
scholars as providing an early view of the importance of management as an 
intellectual resource, insists that the firm is a bundle of resources which only 
have value in that they are able to provide a flow of benefits, and that this 
flow of benefits is very dependent on the intellectual resources of the firm’s 
management. Given the ubiquitous nature of the proposition that 
organizational learning is valuable, the obvious question which presents 
itself is how do organizations actually leam? 

2.1 How Organizations Learn 

Although all organizations leam, they do not all leam in the same way. 
Each organization has a preferred learning style, just as human beings and 
other organisms do. We now define three dimensions to this learning style or 
orientation, the focus, the process and the scope of organization learning. 

The focus aspect of learning concerns what the organization learns. In 
particular, whether the organization learns (i.e. adapts) by changing its 
products and/or services; or whether the organization prefers to leam by 
adapting its processes (e.g. substituting technology for labor, or one type of 
labor for another; or changing its business model, for example, by 
outsourcing). Thus organizations leam either by doing different things in the 
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same way, or the same things in different ways. Most organizations will do 
both, but organizations may have a bias towards one or the other. 

The process dimension concerns how the organization learns (adapts) 
rather than what it learns. Thus an organization may learn by adapting either 
what it makes, or how it makes them, but there are alternative learning 
processes by which this adaptation can be achieved. We scale the 
organization’s preferences in this dimension according to whether the 
learning process is open or closed. An open learning organization is flexible 
in the means it uses to effect adaptation. A closed learning organization is 
one where there are fixed rules and procedures about how learning takes 
place. 

The scope dimension of organization learning concerns who learns. This 
is either narrowly defined, in which case there is a very targeted approach to 
learning, and little attempt to create ‘cascades’ or spillovers. Different 
product groups or functional specialists or layers of management learn 
different things. If the focus is broad, then there is an active attempt to treat 
learning as a single pool, a common resource shared throughout the 
organization. 

The essential point is that organizational learning is at least as complex as 
individual learning. This complexity requires a great deal of thought on 
behalf of educationalists who seek to develop relationships with 
organizations as entities which leam. Furthermore, the key role of learning 
as part of sustainable competitive advantage will place at a premium the 
ski ll s needed to manage this relationship. 



3. THE ECONOMICS OF LEARNING 

Recent work in applied industrial economics has traversed the same 
territory as the models of organization learning referred to above. In 
particular, within evolutionary theory (see Nelson, 1995) as well as within 
the related Resource Based Theory of the firm (see Teece et al. 1990), the 
notion of learning is central to a dynamic theory of the firm. Equally, 
theoretical economics has been full of research into how expectations and 
beliefs are formed within the context of a ‘learning process’. 

The economics of learning has four main strands. First, there is the 
research program concerned with bounded rationality, which posits learning 
as an alternative to rationality as a basis for the theory of choice (for 
instance, Neural Networks and artificial intelligence models - see Holland, 
1995). Secondly, there is a strand of learning theory which is concerned with 
justifying the existence and stability of the equilibria in economic models 
which are sensitive to the assumptions made about the nature of rationality 
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which agents possess (Kreps, 1990). Thirdly, there is a need for learning 
theories in order to show not only how an equilibrium is stabilized but how it 
is selected from a potentially very large set of multiple equilibria 
(Grandmont, 1994). Fourthly, and finally, there is a need to explain observed 
behavior which is out of equilibrium, highlighting that there is something 
fundamentally wrong in the models themselves, but which is often then 
corrected when learning is explicitly incorporated into them (Marimon, 
1997). 

In order to make a link between the economic theories of learning and the 
Organization Theoretic (OT) models of learning, it is useful to compare 
these different ‘learning’ paradigms, i.e. that of management and that of 
economics. There is one striking similarity which is that both approaches 
define learning as adaptive behavior by agents. Moreover, both the 
organizational theory and the economic theory approaches are happy with 
the notion of the organization as an agent - for instance, economic models 
of learning are happy to conceive of learning as taking place at the level of 
the firm. 

However, the model of learning that economists have in place has a 
slightly different purpose to that of the organization theorists. Principally, 
economics is not concerned to explain learning as an end in itself. To put it 
very starkly — just because learning is the way firms actually behave is not a 
good enough reason for an economist to study it, though it may be for an 
organization theorist. 2 

The reason for this is that if we discover that learning simply explains 
how our models achieve equilibrium, they have added nothing veiy much to 
our tool kit - except they may add some complexity to the stoiy we tell. On 
grounds of parsimony, at least, we would thus exclude the theory of learning 
from future research, since we can achieve the answers we want by simpler 
means. 

However, if learning allows us to change the predictive content of 
models, then it is of significant interest to economic theorists. If, for 
instance, we need learning to explain how the equilibrium is selected over 
another, and if both these equilibria are indistinguishable within our more 
axiomatically rational choice models, then a theory of how organizations 
learn is a necessary part of the economic theory of the firm. If this is so, 
there is also an important policy prescription from learning theory. If we 
show that learning is important for equilibrium selection and justification, 
then we have the possibility that a particular equilibrium may be achieved 
more easily when it is learned more easily. Thus, learning can become an 



2 

Many observers would argue that realism is not perceived by economists as being an 
important concern in economic models, implying that only predictive efficacy is essential. 
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important part of policy development at all levels. In this area, the concerns 
of the economist and the organization theorist converge. The organization 
theorist is concerned with learning in organizations and wants to understand 
how organizations reach their equilibria, (i.e. their strategies) regardless of 
whether there is a less realistic, more elegant model which explains which 
strategies they reach. The economist only wants to understand learning if 
there is no alternative, reduced-form model. 

However, in the context of policy formation and the response by an 
organization to it, these interests converge. The organization theorist is 
interested in how organizations learn, and the applied policy work these 
theorists do is identified to assist in the management of this learning. 
Equally, an economist would want to improve the ability of the organization 
to make the correct response to policy changes, and would be concerned 
with how organizations actually do learn. An understanding of how 
organizations learn will improve the efficacy of policy decisions. Thus there 
is a case for economic models being enhanced by Organization Theory 
models in ways which add something to economic theory and policy. 

Equally, the process of incorporating the Organization Theory 
perspective on the effectiveness of learning into economic models of 
learning may throw up some very precise definitions about what exactly 
constitutes a Teaming algorithm.’ The mathematical formalism which 
characterizes economic theory may add something to the field when coupled 
with the more contextual, cognitive process model in Organization Theory 
(see above), since the formal model is often much more general. Thus 
economics may (and we believe will) add greatly to the understanding of 
learning in organizations. 



4. THE LEARNING PARTNERSHIP AND 
LEARNING ORGANISATION 

One outcome of this interest in the role of learning for both organization 
theorists and economists is the possibility that relationships between 
Business Schools and the organizations that use their services may have to 
alter. What do economists have to offer MBA students in addressing 
organizational change, for instance, when they understand organizations to 
be evolving in a behavioristic way rather than as neoclassical production 
function optimizers as argued by economists? How does a Business School 
alter the executive courses it offers to its clients when it sees those clients to 
be continuously engaged in a process of learning already? For example, if 
organizations such as Motorola or British Aerospace or Microsoft decide to 



Learning & Organization 



63 



manage learning as a key strategic competence, what does this mean for the 
relationships they form with external providers of education and training? 

One possible framework for the role of a Business School in such 
interactions is represented in figure 1 below, which seeks to capture the 
essence of the ‘ learning partnership ’ approach. The cyclical nature of the 
diagram captures the self sustaining nature of the partnership: this is a 
dynamic relationship between the partners. 
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Figure 1. The Learning Partnership Model. 



There are three elements to this learning partnership model: (a) the 
relationship between the manager and the Business School; (b) the 
relationship between the manager and the organization; and (c) the 
relationship between the Business School and the organization. We describe 
each in turn. 

First, the relationship between the manager and the business school is 
defined by the extent to which the manager is able to rea li ze the human 
capital which the learning in the business school develops. This realization 
of the value can only take place in an organizational context, and thus the 
role of the business school is to develop in the manager not only a skill but 
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an ability to transfer his or her skills into the organization. This generally 
means that the manager will learn not only technical skills, such as finance 
or strategy, but softer, behavioral or affective ski ll s. Thus, the manager 
learns skills as an individual, and these skills may be transferable s ki lls 
which have wide applicability for the mangers future career. But the 
manager also learns the skill of transfer, since without this he/she is unable 
to fully realize the value of the cognitive skills. We define this element of the 
three-way learning partnership between the managers and the business 
school, as the ‘ learning of management' . 

The second element in the three-way partnership is that between the 
manager and the organization. The concept of a learning contract is useful in 
this context: both partners will usually have agreed objectives for the 
learning which is to take place, which will often be defined as measurable 
outcomes and may even form part of the formal appraisal process. The 
individual manager expects a commitment from the organization, say, in 
terms of career progression as a consequence of the commitment to develop 
new skills. Moreover, the organization needs to be aware of how to capture 
the value of the training in which it makes a joint investment with the 
manager. Specific mentors and /or sponsors within the organization who 
hold a stake in the learning process and its outcomes will often be appointed. 
Thus the organization and the manager are engaged in a process which could 
be described as The Management of Learning, which is an essential adjunct 
to the Learning of Management between the manager and the Business 
School. An effective learning partnership requires that both of these 
processes are present, that both contracts exist and support each other. 

Third, there is the relationship between the Business School and the 
organization. Clearly, there is often a financial contract between the business 
school and the organization, but there is also an implicit learning contract 
between these two in the learning process which is our primary concern in 
this paper. Acting as providers of management learning, at whatever level, is 
just one aspect of the work of a Business School. If set within a University 
context, the Business School is (or should be) dedicated to learning, and this 
means the creation of organizationally relevant knowledge (whether pure or 
applied) as well as the disse mi nation of this knowledge. Thus the third 
learning contract in the three-way learning partnership is a research agenda, 
which supports the other two elements in the partnership. It is difficult to 
imagine a learning partnership lasting over time without this ongoing 
development of new knowledge and it is equally difficult to imagine how 
such knowledge could come about without some form of engagement with 
business organizations. 

Thus, the Learning Organization in the title of this paper is a three-way 
partnership between managers, organizations and Business Schools. It is not 
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the company, nor the managers, nor the Business School in isolation which 
are defined as ‘the learning organization’ in themselves, but this new 
organization they create between them. Creating this partnership is what we 
mean by ‘ The Organization of Learning’ . 

There are various implications of such a concept of learning organization 
for the process of educational innovation, a few of which we now consider. 
First, there are striking potential linkages between the idea of the learning 
partnership and the new models of a university, which are being developed 
by the leading-businesses. For instance, the corporate universities of 
McKinsey or Motorola seem to fit well with this concept. Equally, the term 
‘virtual university’ has started to be used with particular reference to a 
‘University for Business’. At the level of the partnership the concept 
outlined in this paper is just such an entity in the sense that the learning goes 
on within an abstract, intangible entity, which is made up of nevertheless 
very real constituents: real managers, real businesses and real universities. 



5. IMPLICATIONS FOR THE CURRICULUM: 
EXAMPLES FROM ECONOMICS 

Notions of knowledge management and learning are not only changing 
the relationship between Business Schools and the organizations they serve, 
but they are also changing the nature of the curriculum within the Business 
School. In this final section of the paper we review the ways in which the 
curriculum has altered in line with these new organizational and academic 
imperatives. Our aim is to illustrate such changes rather than to develop 
generalized rules, and thus we confine ourselves to the economic curriculum, 
the area we know best. 

The growing concern of economics with knowledge formation, which 
explores the boundaries between learning and rationality, has been reflected 
in the way the content of core economics courses has been changed within 
some (especially British) Business School MBA programs. In this final 
section we refer to examples of how this has occurred. 

Today, much more time is typically given over to a careful analysis of the 
nature of the firm as a behavioral entity, covering such topics as agency 
theory, information economics, incentive compatibility and tournament 
theory. Typically, in both the US, the UK and Europe, innovative economics 
courses are concerned with strategic interaction between the firm and the 
market, often using game theory, stressing the role of conduct (strategy) in 
determining industrial structure. Such courses are now almost entirely 
concerned with imperfect competition and particularly oligopoly theory, and 
hence deal head-on with competitive rivalry, analyzing strategic 
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management within an economic paradigm. Typical issues on such a course, 
like strategic pricing, marketing activity in different environments, 
innovation and R+D and investment decisions are treated as being both 
highly relevant as well as rigorously based in theory. 

The consequences of these recent innovations in changing the nature of 
economics presented to a business audience are encouraging for a number of 
reasons. 

• First, students become aware of economics as a discipline which li nk s 
theories of organization with theories of strategy. This has important 
implications for the future role of economics in Business School 
curricula: the value of studying economics is that it is a particular “way 
of thinking” rather than a set of problems of concern to only economists. 
The case for integrating economics into a single, core program, say by a 
series of l in ked cases and common assessment is strongly supported by 
this experience. This is particularly important in a Business School 
where every issue which an economist addresses has to fight for 
attention from other perspectives. Thus, labor market economics 
contends with HR models which are at least in part non-economic and, 
similarly, with models of competitive processes, where economics is in 
debate with strategy, or consumer theory where economics must fight 
for attention with some very seductive models based on sociological and 
psychological paradigms. 

• Secondly, the models of organizations and markets presented in 
economics are immunized from the standard criticism that economics is 
too abstract to be included on, say, MBA programs. This critique usually 
asserts that economic theory requires an assumption of too much 
rationality for the models to be of any use to practicing managers. Our 
concern with adaptive behavior and bounded rationality and the 
economics of learning greatly weakens this challenge. Economics gains 
in credibility by starting from the same sort of grounded assumptions 
that marketing, finance and strategy make. 

• Thirdly, the pedagogy needed to deliver this kind of teaching is different 
to traditional economics teaching methods. In order to teach and to 
assess such material there is a need to develop a number of case studies 
and some of these have been useful research exercises both from an 
academic and from a pedagogic perspective. 

• Finally, the results of our experience in applying these principles have 
been very encouraging in terms of building the status of economics 
within one economics curriculum. There has been a significant increase 
in the rigor of the economics we teach in our attempt to incorporate 
more realistic assumptions about the real workings of the economy. This 
is because many of these new theories are at the forefront of the 
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academic profession’s research agenda which makes this material 
challenging and new even for those of our students who have had 
previous training in economics. 

We would conclude, therefore, that as Business School economists we 
have some confidence in the future since our discipline is developing 
theoretical tools which are directly relevant to the business world and models 
of learning are but one example of this. Moreover as Business School 
academics we are also hopeful that the rise in status of knowledge and its 
management within firms is likely to lead to an increased rather than a 
diminished role for the business schools as partners with organizations. 
Finally, as educationalists interested in innovation, we offer the concept of 
‘The Learning Organization’ developed in this paper, and reiterate its key 
features. First, it is (at least potentially) virtual; second, it is ajointly owned 
andjointly managed entity and hence inherently co-operative. 
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1. INTRODUCTION 

There is a compelling logic justifying, even lauding, the beliefs and 
practices of traditional business programs. After decades of acceptance of, 
even commitment to, that logic, it is very difficult for faculty to question it, 
much less overcome it. The typical Information Systems (IS) department 
rejects that logic, and suggests an alternative way to think about business 
programs. The traditional logic encompasses the purpose of the department, 
the pedagogy, the priority of research; it defines the roles of the faculty and 
of the students. It can be called the discipline-based model. The mission of 
the department, it asserts, is to discover, develop, protect, and explain the 
discipline. The profession’s body of knowledge is valuable in its own right, 
not because practitioners find employment in the field. The faculty is the 
preeminent experts and developers of the knowledge base. They develop the 
discipline both by research and publication; they train new students to 
become experts in the field. Teaching is then understood as an initiation into 
the profession, the way in which to convey knowledge and understanding of 
the discipline. A few of the best and the brightest students succeed in the 
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ultimate testimony to the faculty by completing the Ph.D. and becoming new 
faculty. 

The alternative logic, again one which defines the purpose of the 
department, the pedagogy, the roles of students and faculty, is the “student 
customer” model. IS departments typify and exemplify this model. It is a 
service model, giving priority to discovering and satisfying the customers 
needs. It assumes that business students elect their majors with the clear 
objective of using the degree to start a career in that professional field. The 
mission of customer-oriented business departments is to prepare students for 
careers in the field. Continuous placement of students with companies 
requires keeping employers satisfied; hence both students and employers are 
customers. Employers are better and better at articulating the skills and 
competencies which they want in new hires; they want students who can 
perform the professional work on the first day; they want to avoid the costs 
and uncertainties of training new employees. Both employers and faculty are 
coming to the realization that “performance” criteria, the skills and 
competencies to perform the professional tasks, are best learned by 
practicing them. The traditional pedagogy, based upon textbook “cover-the- 
materials” approach, is not nearly enough; applied skills cannot be learned 
by reading about them, they must be performed over and over again. 

There are widening conflicts between professional practitioners in the 
workplace and the faculty in academic departments. The often-stated belief 
about the value of research-model is that research advances the discipline, 
while keeping the faculty and curricula up-to-date. Employers and students 
alike dispute that claim, both express concern that students lack the skills to 
practice their profession. The widespread usage of calculators in the business 
curriculum indicates a disconnect between business training and business 
practice. Financial functions and tasks are performed with computers in the 
workplace, but not in the curricula. This paper will take a stereotypical look 
at two departments: Accounting and Information Systems. Accounting is the 
best example of a discipline-based model, Information Systems of a student- 
centered model. Accounting is the most out-of-date, and its majors are 
disappearing; Information Systems is the most in touch with real-world 
careers, and its majors are rapidly growing. 



2. INEVITABILITY 

In business contexts with short product life cycles, survival depends on 
innovating, creating products or services which meet the needs of fickle 
customers. The survival of the business college depends on its having 
customers, both students majoring in its programs as well as business 
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employers. Customer retention, in turn, depends on staying focused on the 
ever-changing career requirements of business fields. Only then will the 
internal rate of change begin to accelerate, as it attempts to close the gap 
between its content and business practices. 

Herman Hesse’s Magister Ludi is a critique of the superior German 
intellectuals who seclude themselves from the chaos of the real world. T hi s 
book seems an apt description of many of our research universities. The 
discipline-based model justifies the emphasis on the discipline and the 
disdain for business practices, since they often don’t measure up to the ideal. 
A symptom of the problem is that innovations in business practice, which 
prove themselves in the marketplace, reports take years to be accepted into 
the scholarly literature and into the classroom; by that time, more recent 
innovations have become “best practice” in the workplace. Students starting 
business careers experience a time warp, a feeling of not being prepared 
frustration with their faculty. When employers hire, they often see little 
difference in relevant skills between business majors and political science or 
communication majors. That is really damning. 

Many business colleges are experiencing declining enrollments. But 
business Colleges with good records of placing students into professional 
careers cannot meet the demand for their services. The brighter students 
want business careers, and they will seek out colleges where the reputation 
of the college all but assures placement into a career. Nowhere is this 
phenomenon clearer than in IS departments; programs with good reputations 
are literally overwhelmed by the number of students. At the same time and 
in the same college, the numbers of majors in accounting, operations, human 
resource management, management, etc. are dropping. Student customers 
are rational; good academic programs grow and succeed, poor service drives 
away students. 



3. IS AS PROTOTYPICAL 

A prototype is a realistic model, predictive and descriptive of how the 
real thing will turn out. Other business departments can view their own 
futures by considering the essential characteristics of the current IS 
departments. Accounting, Finance, Marketing, Management, HRM will be 
forced to become more like IS - that future is inevitable. That is the claim. 

Here are the characteristics of IS that are prototypical: 

1 . Faculty and curriculum are focused upon careers for the student 

customers; this is the defining characteristic for successful professional 
business programs. 
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2. Employers’ technology requirements shape the curriculum, shape the 
students’ preparation for IS careers. 

3. These technology requirements are continuously changing as business 
operations are redesigned, hence IS skills must be continuously upgraded 
to reflect best business practices. 

4. Employers want IS graduates to bring skills and competencies to the 
workplace, not just “knowledge” about IS, hence the pedagogy must 
include hands-on “action learning.” 

5. IS learning is embedded in real-world business contexts, the pedagogy 
must be project-based solving business problems. 

6. The IS pedagogy casts faculty in the roles of mentor and coach, and 
faculty interaction with students builds student satisfaction with that 
humane and caring environment. 

7. Since business computing is ubiquitous, faculty computing expertise 
should surpass student expertise and be continuously upgraded and 
expanded. 

Many IS departments, my own included, are experiencing unprecedented 
growth in the major, unprecedented demand to get into courses, accolades 
from graduates whose average salary last year exceeded $40,000, and 
accolades from prominent employers. Employers, students and IS faculty 
hold up the IS department as a model for other departments, exhorting them 
to be more focused on preparing graduates for business careers in their 
fields. An excellent way to validate the prototype is to invite prominent 
business people to be guests of the IS program and invite the President and 
Provost for lunch. Partners from the Big 6 Consulting firms, whose 
continuing growth depends upon good IS programs for new employees, 
speak convincingly about the value of the IS programs. Steve Alexander, 
interprets ComputerWorld’s 1999 mid-year salary survey, which lists 
salaries by specific title and by location; he summarizes his concern about 
the unmet demand for IS positions and how it is driving up salaries: 

“If 1998 was a great year to be in IT, 1999 looks to be more of the same: 
rising salaries, personnel shortages that spell tremendous opportunity and 
signing bonuses for those who are most in demand. Salaries have risen so 
sharply in the past year and a half that information technology managers 
are struggling to keep up with market rates — or to even know what they 
are.” (Alexander, 1999). 

Faculty from traditional business departments find it easy to reject IS’ 
leadership. Discipline-based departments dismiss as irrelevant the growing 
number of IS majors, the career successes of the graduates, the gratitude of 
parents and students. And this is where their credulity breaks down. Their 
response echoes from the distant past, the glory days of yesteryear. Faculty 
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from discipline-based departments respond by pointing out that IS is not a 
real discipline, IS teaches only techniques and skills, IS lacks any substantial 
content and a substantial knowledge base. Academic administrators, 
bewildered by the demand for IS and unwilling to provide needed faculty, 
argue that computing is a fad, like the internet; the author noted his concern 
that electricity and phones were also fads. But it is clear that the non- 
traditional IS department cannot find acceptance as a prototype for other 
departments, when one starts from the assumptions of the discipline-based 
model. The discontinuity must be understood and addressed if there is to be 
progress in moving other departments to a student-centered approach. 



4. AN EPISTEMOLOGICAL ASIDE 

Aristotle’s influence on psychology and education still holds sway after 
all these years. The Greek term “episteme,” translated as knowledge, is 
divided into scientific (theoretical) knowledge (judgements about the 
universal and necessary) and practical knowledge (deliberations about 
politics or ethics). Business knowledge would be an oxymoron for Aristotle. 
Business expertise is really art, “techne,” technique or the ability to create 
things; art is learned from experience, from practicing. Generalizations or 
concepts are inferred from the successful practice of the art and are passed 
on to the apprentices. Few IS faculty have pretensions of conveying 
scientific knowledge or great wisdom, as will be noted below, IS is not a 
discipline. 

Can we learn how to swim by reading a book? Learn how to ride a bike 
that way? Learn how to do business that way? Knowledge is an ambiguous 
term; constructivist views are now popular, but Aristotle and Kant’s views 
might be more instructive- All knowledge is empirical knowledge, all 
knowledge derives from sensation: “Nihil in intellects, nisi prius in sensu.” 
We organize and interpret the perceived objects of sensation and make 
judgements about them, employing the concepts already in our minds. 
Randomly grabbing a textbook from my shelf and randomly opening it 
yields this concept: “Horizontal differentiation focuses on the division or 
grouping of organizational tasks to meet the objectives of the business.” 
There is no context for learning, no experience to situate these conceptual 
terms. The author (and faculty teaching from this book) make a tacit 
assumption that “a priori” knowledge, the direct grasp of concepts without 
experiencing the objects, is possible. The philosophers dispute the possibility 
of direct a priori knowledge, Aristotle’s Christian followers attribute such 
knowledge to angels: “Angelus scit a priori sed homines scit a posteriori.” 
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Book learning also fails to build s kill s and competencies because the 
concepts are too simplistic, the tasks large and more complex. Again, 
experience would have inform us of the size and complexity of the task, the 
amount of expertise needed to perform it. Trying to become a financial 
manager by reading an Accounting textbook is a good example. The typical 
textbook approach of teaching concepts to students who lack an experiential 
context in which to place them, results in filling their heads with free- 
floating abstractions — mere data, mere words, not even information. 

In the terminology of Constmctivism, in which knowledge (mental 
models) are built from relevant information, textbooks offer pre-packaged 
“knowledge,” saving students the effort of “constructing” it. Textbooks often 
provide tables of principles, categories, or procedures with little information 
about the inferences which created them. Even more serious is Peter Senge’s 
claim that mental models are often wrong, and because we do not reflect on 
them, much less modify them, mental models can readily impede learning. 

“Contemporary research shows that most of our mental models are 
systematically flawed. They miss critical feedback relationships, 
misjudge time delays, and often focus upon variables that are visible or 
salient, not necessarily high leverage.” Senge (p. 203). 

Learning is much more difficult than constructing mental models. Mental 
models are inherently simplifications, perspectival, often too vague and too 
static to deal with dynamic and complex tasks, e.g., business processes. As 
the philosophers Hegel and Nietzsche noted, learning occurs after reflection 
on the inadequacies of our mental models forces us to construct more 
sophisticated models; Nietzsche would say that learning occurs when we 
overcome our truths. The 1956 Taxonomy of Educational Objectives still 
stands as the defining standard for levels of learning; Bloom’s (the editor) 
taxonomy lists these six “educational behaviors from simple to complex:” 
knowledge, comprehension, application, analysis, synthesis, evaluation. 
(Bloom, 1956). Bloom equates “knowledge” with the acquisition of 
information, the “processes of remembering,” the lowest level kind of 
learning. Textbook learning cannot meet the demands of a professional 
school. It falls short of the task of preparing business students who can apply 
concepts and models, who can analyze and synthesize, who can evaluate and 
reconstmct. 

Like the music, theater, and TV Production departments, the IS 
department is acutely aware of the role of skills in performing the requisite 
tasks. Skills such as analysis, synthesis, evaluation of processes are part of 
the day-to-day tasks of an IS consultant or a financial manager. Students 
need to learn a suite of “competencies” in order to be effective performers. 
Hamel and Prahalad use the term “competency” which they define as the 
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“package of skills and technologies giving mastery of a key process” (Hamel 
& Prahalad, 1994). Richard Boyatzis defines competencies as “the 
characteristics of a person which results in superior job performance; the 
characteristics include knowledge, skill, motivation, etc,” (Boyatzis, 1982) 
Competencies include skills, concepts, and technologies; effective 
performance requires that all three function together. 

The IS departments’ pedagogy evolved and developed in such a way that, 
now after the fact, the competency-based approach represents a good 
description of the approach used. Much like Constructivism, learning takes 
place by practice building mental models of how the task is to be performed. 
The models are learned from experiencing the processes. The IS vocabulary 
is familiar before the skills are developed; the models and concepts are 
learned after the fact from the experiences of completing the tasks. What is 
different is the emphasis given to the computer tools and skills, which are 
regarded as essential to the learning, to the performance of the task. 

Employers want graduates who can add value to the company on the first 
day of work, i.e., graduates with the typical competencies required in the 
functional area. An Accounting or Finance major who have never used 
accounting software must spend weeks in training before they are ready to 
really do the job; but an English or Philosophy major — we have all heard 
how wonderful they are as employees — must spend months in training 
learning about business in general, the functional area, and the computer 
tools. 



5. THE SAD STORY OF ACCOUNTING 

A feature story in the New York Times tells the story of how and why the 
accounting departments, indeed the accounting profession, shot itself in the 
foot. Some of the ways to look at the wound: 

• The article reports that the number of college students graduating in 
accounting has declined by 50%. 

• The number of public companies requiring audits is growing. 

• Only 12.5% of applicants taking the C.P.A. exam pass it on the first try, 
the lowest percentage since 1985 when the exam was inititated. 

• The SEC has expressed its concerned about the quality of audits. 

During the decade from 1970 to 1980, the accounting profession was 
perceived as an attractive profession, with continuing growth all but 
guaranteed, with high starting pay and lots of opportunity for promotions 
into very high paying jobs. During this period, the accounting profession 
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erected a number of barriers to entry, both to restrict the number of 
accountants, and to ensure the quality of profession: 1). The C.P.A. exam 
was made more difficult, 2) the C.P.A. required two years of experience, 3) 
and the educational requirement to sit for the C.P.A. exam was raised from a 
4 year bachelor of business program to a 5 year degree. The barriers worked. 
College students are deciding that it is not worth 5 years of college and 2 
further years of apprenticeship to sit for a C.P.A. exam designed to flunk 
87% of them. Enrollment is falling across the country. 

Accounting is a good example of a business program in which faculty see 
their primary allegiance to the profession, not the students. The profession, 
arrogantly confident of its allure, chose to impose very high standards for the 
accounting majors, and now the accounting departments must live with 
rapidly declining enrollments and the profession must struggle to ways to 
audit a growing number of companies with fewer licensed auditors. The 
profession is now fully aware of the problem which it created and will 
probably lower the barriers to entry, but that will have little effect on the 
decline in enrollments until it is a reality. But the accounting faculty, still 
committed to the profession rather than the students, reject the notion that 
they have an obligation to facilitate the career aspirations of the business 
students. So the student customers, with a wide range of career 
opportunities, are going elsewhere. 

Accounting is more like mathematics or business law than other business 
fields, in the sense that its concepts and rules are human artifacts, rather than 
abstractions from business practice. Management, Marketing, and IS 
curricula are based upon business practice. Faculty in Accounting can truly 
master then' content, because it is a man-made, internally consistent system 
of principles and concepts. Unlike other business disciplines, accounting has 
answers which are true or false; because accounting has an artificial internal 
consistency, its answers are tautologically true. 

Applying these principles and rules to the ambiguous and changing 
realities of business operations suggests a distinction between the practice of 
accountancy, e.g., preparing tax forms, and the discipline of accountancy, 
e.g., mastering tax laws. Understandably, most accounting faculty are not 
interested in preparing students with the skills to practice accountancy; the 
accounting curriculum emphasizes mastery of the principles. Unfortunately, 
the C.P.A. exam focuses upon applying the principles. The 12.5% average 
rate of passing the exam illustrates the validity of the distinction. The 
pedagogical emphasis is now seen as a major concern. 

Not every faculty member puts the emphasis on the established content 
of the field. A professor of Accountancy at Miami University (of Ohio) 
thinks that his tax course should prepare students to help businesses 
mini mi ze their tax obligations to the federal government. The course is not 
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about tax regulations, he makes all the tax regulations accessible on a CD- 
ROM drive — there is no point of memorizing the regulations when tax 
people just look them up. He assigns the students a typical real-world tax 
problem: “show me how IBM (look up their financials on Edgar) can save 
$1 million by smart usage of the latest tax revisions.” He gives away the 
information in order to move to application, analysis, and creativity. The 
irony here is that students really learn the relevant tax regulations! The 
students love this emphasis, readily understanding that someone who knows 
how to save big money on taxes is highly employable. 

There is an irony to adding a 5th year to the accounting program, having 
the C.P.A. rate decline to its lowest level since its inception, at the same time 
the profession demands more experience. The New York Times article 
expressed concern about the efficacy of the Accounting programs’ 
pedagogy: “The classroom is a great primer, but it sure doesn’t get you 
there.” While it is a simple matter to design an exam so difficult that no one 
can pass it, the embarrassingly low pass rate is a strong indictment of the 
accounting programs’ pedagogy. The emphasis on “concepts” and the trivial 
calculator problems has failed to produce competent practitioners. So two 
years of experience are required before certification because the textbook 
learning fails to develop the requisite skills. The chairman of Kansas’ 
licensing board had this comment about textbook learning: “It’s only by live 
experience in public accounting. . .that you can gain the skills and objectivity 
that we believe are key.” At this point very little has changed in the 
accounting departments. Acutely aware that the 5th year requirement was a 
serious mistake, faculty fear next year’s consequences, since the requirement 
does not take effect until the June 2000 graduates. 



6. IS IS NOT A DISCIPLINE 

“IS is not a discipline,” is an oft heard criticism. It is hard to know what 
that means. Clearly it is a way of finding fault with student-oriented 
programs based upon assumptions and beliefs of the discipline-based 
faculty. To some it means that IS lacks sufficient content to be taken 
seriously as a discipline or department. But it might well be a sign of the gulf 
between knowledge-based disciplines and performance-based “art” 
programs. Colleges of Arts and Sciences have difficulty accepting “Art” 
departments, because of their lack of content, and have pushed them out into 
Colleges of Fine Arts. It even seems as if Arts and Sciences would like to rid 
itself of the physical science departments by pushing them into Engineering. 
Arts and Sciences has perverted “science” such that pseudo-sciences, such as 
sociology and psychology, are more prestigious than physics and chemistry. 
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Indeed, the Ohio University Provost holds the Psychology Ph.D. program up 
as the model for other programs to emulate, even though very few of the 
graduates can find employment in that field. The conflict, writ large, is that 
the discipline-based perspective holds up the master-the-content “scientific” 
knowledge disciplines as examples, while performance-based “Art” 
departments, such as IS and engineering, point to the successes of their 
students in real-world businesses and ridicule the traditional disciplines as 
irrelevant, out-of-touch pseudo-sciences. 

IS is not a discipline because it does not have well established 
foundational theories or principles which would define its scope and 
purpose. The theoretic foundations for disciplines come after-the-fact, after 
the practice is well established. The theory is abstracted from the practice. 
While Law and Medicine are well established disciplines (the first doctorates 
were granted in 1240 and 1270), engineering never made it at Oxford 
because it did not date back to the 13th century. IS practices are rapidly 
changing, radically changing, making it impossible to define what it is and 
where it is going. There are concepts and mental models aplenty. There is a 
flood of published material about IS. IS, in that sense, has more content than 
other business disciplines. IS concepts are invented daily, e.g., a virtual 
office consists of a portable device incorporating a cellular or satellite 
modem and software enabling on-line interaction with other business 
partners. And IS truly experiences paradigm shifts, e.g., the cover of 
Business Week suggests that PCs are obsolete, radically new mental models 
of the field; these obsolete the old theories and concepts and redefine the 
possible. The sheer amount of information about IS products and events is 
daunting. Every day there are hundreds of announcements on the internet 
about new computer devices, new software. There are daily editions of 
popular computer magazines published on the internet; there are weekly 
paper copies of these magazines freely distributed to MIS professionals. The 
content is both huge and fast changing. No single person or textbook can 
claim mastery of the field. So what do IS faculty elect to teach? The 
curriculum is shaped by what the employers use! 



7. HOW OTHER DEPARTMENTS WILL FOLLOW 
THE IS LEADER 

What does it take for a group to redefine itself? Probably a “burning 
platform,” to make the current situation untenable, e.g., declining 
enrollments and faculty reductions, and a vision of the future that appears to 
improve upon the current situation. Many business departments are 
experiencing declining enrollments; but the fire is ignited when faculty are 
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terminated because of fewer students. Accounting departments across the 
country are losing faculty and feeling the heat, but they do not seem capable 
of rethinking their basic logic. These accounting faculty need the dean to 
redefine their mission for them. The discipline-based approach justifies 
ignoring students’ needs; the student-centered approach would react to 
student concerns and find ways to better serve their needs. When business 
students’ expectations for a high-paying job are unmet and ignored by the 
faculty, the rationality for majoring in business is removed. Students “walk.” 
Were the business college redefined by a vision of business students being 
successfully placed into business careers, faculty goals and students’ goals 
would be the same. Students buy in, find satisfaction as they make progress 
toward a career, they direct other students to the program, enrollment grows. 

The transition from the discipline-based role, where faculty are the self- 
defined experts, to a service role, where faculty serve students, is a humbling 
one. Often the underlying impediment to change is that faculty are unaware 
that they are acting upon and committed to a mental model — the discipline- 
based logic — which they have not articulated. Faculty need to be part of a 
facilitated discussion where they are asked to make their tacit assumptions 
about their relationships with students explicit. Only then can these 
assumptions be critiqued and rethought. Peter Senge, influenced by Hanover, 
Argyris, Beckett and others, suggests four steps to help people rethink and 
critique their mental models so that they can then be open to change: 

• Recognizing “leaps of abstraction” (noticing our jumps from observation 
to generalization) 

• Exposing the “left-hand column” (articulating what we normally do not 
say) 

• Balancing inquiry and advocacy (skills for honest investigation) 

• Facing up to distinctions between espoused theories (what we say) and 
theories-in-use (the implied theory in what we do) (Senge, 1990). 

Once faculty recognize their service role, their dependence upon 
students, the redesign of the curricula can begin. T hi s second step is a 
defining one; faculty must develop curricula that provides the skills and 
competencies which employers need. Employers define the needed modules, 
not the specialties of the faculty. Faculty must abandon the paternalistic “we 
know what’s good for these students.” Once business realities shape the 
curricula, changing business practices should drive continuous upgrading of 
the curricula. “Changing business practices” does not mean that the IS 
curriculum should jump from programming language to programming 
language, for example. It does mean that major long-term changes in 
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business practice like Business - to - Business / E-Commerce practices or 
Microsoft’s do mi nation of the network server market need to be made part 
of the curriculum. 

The third step, that of redesigning the pedagogy, is also driven by the 
requirements of the workplace. Students have skills and competencies even 
more than concepts and principles. The “cover-the-material-in-the-textbook” 
pedagogy has to yield to pedagogy which develops performance, skills, 
competencies. It seems self evident that talking about IS, engineering, 
mathematics, accounting, etc does not prepare students to write programs, 
build bridges, graph a dynamic event, or do an audit. Yet most faculty reared 
in the traditional pedagogy find it impossible to rethink what they are doing. 
What is proposed here is dismissed as heretical and wrong-headed. The 
inability to rethink the pedagogy is the biggest obstacle to the effective 
preparation of students for specific careers. Interactions with students are 
time consuming, humbling, and often frustrating. IS faculty have lots of 
experience with coaching, mentoring, and facilitation — that’s what we do. 

“This new faculty role represents a paradigm shift calling for new s ki lls. 
The paradigm shift has been expressed as moving from being the “sage 
on the stage” to serving as the “guide on the side.” The basic skills 
required to be the “guide on the side” (active listening, coaching, 
mentoring, and facilitation) are not characteristic of a significant number 
of faculty members, and thus they must be learned” (Stinson & Milter, 
1996 ). 

Getting faculty to give up their “sage on the stage” role is very difficult, 
they just don’t understand how students can learn without the lecture 
method. The “sage on the stage” controls the classroom interactions and is 
very empowering; the coach watches her or his team perform with few 
opportunities for input. The point is that student learning only results from 
their individual struggles; when faculty cover- the-material and students sit 
passively, little learning occurs. 



8. CONCLUSION 

This paper suggests that there is too much distance between the practice 
of auditing, investing, programming, marketing, and managing and the 
preparation for these careers in the typical business college. Employers are 
unhappy that business graduates cannot perform the required tasks without 
training. Students are unhappy that they are poorly prepared and offered 
little help in finding jobs. So students are electing other majors and 
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enrollment is declining, although the jobs are there, e.g., “Shortage of 
Accounting Students.” is the title of the New York Times article. 

Even a cursory study of academic business departments reveals why this 
problem exists. Faculty have an agenda and a reward system in which 
serving students’ career needs is but a very small part. The discipline-based 
model and the priority of the research agenda justifies giving low priority to 
employers and students’ career needs. The accounting story exemplifies how 
the academic department can continue to ignore the realities of the 
workplace. Since the accounting principles and concepts are a man-made 
construct, and not derived from the evolving practices in the workplace, 
there is a clear rationality for the faculty to pay little attention to the 
workplace. That justification works for accounting, but it cannot excuse 
management, marketing, IS, investment finance, etc.; these disciplines 
abstract their concepts from rapidly evolving accepted practices in the 
workplace. They would like to see themselves as social sciences, but the 
rapid pace of change in the workplace and the slow pace of publishing 
research forces faculty to accept their role as after-the-fact chroniclers of 
business practice. Teaching concepts and ignoring practice only works in an 
imaginary world where change does not occur. 

Consistent with the research agenda is a pedagogy which emphasizes 
mastering content, rather than developing workplace skills. Somehow the 
notion has become accepted that textbook memorization is adequate 
preparation for the workplace, i.e., that talking about how people work is 
much the same as practicing the tasks, that business tasks are accomplished 
when a good grade on a multiple choice test about the task is awarded. It will 
be very difficult to move faculty from their comfort with textbook teaching 
to the recommended “learn by doing,” “learn by experience” pedagogy 
which the IS department has adopted. 

IS faculty stmggle with the criticism of business college colleagues, but 
the success of their graduates and the praise of employers dulls the criticism. 
In most business colleges IS enrollments grow and grow, while Accounting 
enrollments go down and down. But the success can turn to failure and the 
failure to success. Academic Administrators punish the IS department by 
failing to add faculty commensurate with student growth, thereby driving 
away students who cannot get into required classes. Accounting is rewarded 
with lighter teaching loads, fewer students and the same number of faculty, 
giving them more time to publish and reap the rewards of the research 
agenda. But the reality of the marketplace eventually reaches into business 
colleges. When the college’s enrollment drops, the Provost reduces the 
college budget or removes faculty lines. Gee, why have enrollments dropped 
when there is such a strong demand for business careers? It’s much easier to 
make changes now. But there is a strong accepted logic underpinning current 
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departmental practices that has to be overcome before the college can 
redefine faculty goals, rewards and roles in terms of serving students’ career 
aspirations. 
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1. INTRODUCTION 

In the sixties and seventies, automated information systems in the form of 
large computers were primarily used for processing mass data to back up 
administrative and industrial processes. In order to provide the necessary 
computer programs, various methods and techniques were developed. In the 
eighties, personal computers and local area networks emerged and 
information and communication technology (ICT) penetrated all levels and 
almost all work places within organizations. In the early nineties, when 
organizations were confronted with poor company results and ever 
increasing costs for ICT, organizations began to question the contribution of 
ICT to the amelioration of company results. As a consequence, in 
developing, implementing and applying new ICT, the management of 
organizations started to not only take technical aspects into consideration but 
also economical and organizational consequences (Looijen, 1995, pp. 13- 
lb). 

In view of the developments outlined above, the sixties and seventies saw 
the emergence of technical studies aimed at the development of embedded 
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software (studies in basic informatics) and techniques for industrial 
automation and industrial process operation (studies in the technical 
application of informatics). In the eighties, studies were set up in economics 
that focussed on the development of automated systems for the management, 
ad mi nistration and running of organizations (studies in the field of 
information systems). Technical education also offered studies in 
information systems to complement the already existing studies in basic 
informatics and the technical application of informatics. 

On the basis of the above, one would expect that, as far as ICT is 
concerned, informatics studies in economics focus mainly on the 
development of automated systems for the management, administration and 
running of organizations ( information systems), whereas informatics studies 
in engineering also focus on the development of embedded software ( basic 
informatics) and techniques for industrial automation and industrial process 
operation ( technical application of informatics). As a consequence of this 
difference in focus, the occupational domains of informatics studies in 
engineering and informatics studies in economics may only partly overlap 
(indicating the degree in which these two kinds of studies are substitutes and 
hence compete with each other). The more these types of studies play 
complementary roles in the labor market and the overlapping occupational 
domain is smaller, the more we should consider these two studies as useful 
though distinct preparations for later occupational careers. Insofar as the two 
doma in s overlap and studies can be regarded as substitutes, there is a reason 
to wonder whether it is useful to maintain the two studies side by side 
without any modifications. To be able to compare the two types of ICT 
studies, we should, however, consider more aspects than merely the overlap 
of occupational domains. It is important, for example, to know whether the 
graduates from these two types of studies are expected to meet different 
requirements in terms of knowledge and skills in order to be able to 
successfully do their jobs, whether they experience any deficiencies in their 
studies in these respects, and which study requires additional training in 
order to lift graduates to the required level. In this paper, we shall try to 
obtain greater insight in the building blocks for a framework to determine 
the positions of these two ICT studies in relation to each other. 

In the analysis, we shall use as a reference an analysis that we carried out 
before and in which we exa mi ned the importance of informatics-s ki lls for 
economics graduates (Heijke & Ramaekers, 1997). This previous paper 
included not only economics graduates from informatics studies but 
graduates from all economics disciplines. We found that economics 
graduates are more likely to participate in training in the field of ICT if much 
knowledge of ICT is required in the job and if they feel that they have 
acquired insufficient knowledge of ICT during their economics study. 
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Furthermore, we found that employers transfer to the workers the costs 
involved in the necessary ICT training (both costs resulting from low 
productivity and direct training costs) in the form of lower wages. 
Apparently, these skill deficiencies are regarded as a lack of general s ki lls 
and the required training effort therefore offers no exclusive benefits for the 
employer involved. The paper ends with the conclusion that there could be a 
task here for university studies to provide better general ICT s ki lls. 

The structure of the present paper is as follows. Section 2 describes the 
curricula developed within technical and economic university education that 
focus on ICT. The data on the graduates who will be used are described in 
Section 3. The similarities and differences on the labor market between 
informatics studies in economics and informatics studies in engineering will 
be exa mi ned empirically on the basis of three research questions. In Section 
4 we want to characterize the labor market of these two kinds of studies by 
occupation, sector of industry, firm size, economic sector and required 
knowledge and skills. Furthermore, we examine whether graduates choose 
thosejobs in which the required knowledge and ski ll s best meet their field of 
expertise. The second part of the research examines the deficiencies in 
knowledge and s kil ls experienced by the graduates (Section 5), and estimates 
the probability that these graduates will participate in training in the fields of 
ICT and business administration (Section 6). In the third part of the research 
(Section 7) we want to estimate the factors that determine the economic 
value of these graduates for their companies (as indicated by their wages). 
Lastly, Section 8 brings together the conclusions of the paper. 



2. EDUCATION IN INFORMATICS 

In order to provide society with the necessary knowledge of ICT, 
curricula have been developed within both engineering sciences and 
economic sciences, which are directed at this kind of knowledge. For the 
analyses in this paper, we were able to use labor market data on graduates 
from the study of informatics engineering at Delft Technical University and 
the informatics studies within the economics faculties of Tilburg University 
and Erasmus University Rotterdam. 

The four-year study of informatics engineering at Delft Tec hni cal 
University is aimed at training engineers, using scientific knowledge and 
methods, to directionally contribute to the analysis of problems of a 
technological, managerial and societal nature with the aim of developing 
automated solutions. They must also be able to develop, realize, implement 
and maintain such solutions. In the last year of their studies, students 
specialize in one of the following three topics. The first topic, called basic 
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informatics, is directed at the development of embedded software with the 
theoretical foundation of algorithm development and programming. The 
second topic, information systems, is directed at developing information 
systems for determining the policy and the management of companies and 
institutions. Technical application of informatics is the third topic and is 
directed at techniques for industrial automation and industrial process 
operation (Diependaal, 1997, pp. 1-2). 

For the second topic of informatics engineering ( information systems), 
there are counterpart studies within economics, namely the four-year study 
of business informatics at Tilburg University (including the university’s 
‘own’ first-year study in business informatics) and the three-year study of 
business informatics of Erasmus University Rotterdam (which comes after 
the first-year study of economics). Both studies focus on information 
systems for managing, administrating and running organizations. The 
emphasis in these studies is on organizational issues, although technological 
devices such as computers also play an important role. Business informatics 
studies focus on determining information needs; the analysis, design, 
building, testing, implementation and running of information systems; the 
management and security of information systems; the collection, recording, 
processing and filing of data; computer-aided cost-benefit analyses; the use 
of computers in decision support systems; business management 
information; communication issues (data flow); and the modeling of 
organizations and their functioning with the aid of computers (Studiegids 
1995-1996, Economische Wetenschappen, Erasmus Universiteit Rotterdam, 
p. 423). 

In the last year of their four-year studies, business informatics students at 
Tilburg University may specialize in one of the following three topics. The 
first topic, called information knowledge, both broadens and deepens the 
knowledge of information systems and is recommended for students who 
want to take the postgraduate accountancy study. Business organization, the 
second topic, deepens the organizational knowledge by focusing on the 
relation between the way in which firms or institutions are organized and the 
goals of such firms or institutions. The third topic broadens the knowledge of 
informatics with respect to expert systems, AI techniques, computer 
networks and mathematical aspects of the use of computers (Studiegids 
1995-1996, Faculteit der Economische Wetenschappen, Katholieke 
Universiteit Brabant, pp. 65, 69). 

The three-year study of business informatics at Erasmus University 
Rotterdam consists of about 25% mathematics and mathematical operations 
research, 50% informatics and 25% economics. In the last year of their 
studies, students may choose one of the following topics: information 
knowledge, informatics and decision support systems. The first two topics 
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resemble those at Tilburg University. The third topic deepens the knowledge 
of the use of computers in decision support systems. 

In summary, we distinguish two kinds of informatics studies in this 
paper, namely business informatics (BI) and informatics engineering (IE). BI 
includes both the four-year study of business informatics at Tilburg 
University and the three-year study of business informatics at Erasmus 
University Rotterdam. IE consists of the four-year study for informatics 
engineer at Delft Tech ni cal University. As far as ICT is concerned, BI is 
directed mainly at the development of automated systems for managing, 
administrating and running organizations, whereas IE also focuses on the 
development of embedded software and techniques for industrial automation 
and industrial process operation. 



3. THE DATA 

ROA annually carries out labor market research among graduates from 
five economics faculties in the Netherlands. Since 1996, ROA has also 
carried out labor market research among graduates from Delft Technical 
University, including informatics engineers. This research project, known as 
the University Education Monitor, examines both the characteristics and the 
qualifications of graduates and their current labor market position. 

The research data for this paper were obtained from the two latest postal 
surveys, carried out late 1996 among graduates from the academic year 
1994/D95, and late 1997 among graduates from the academic year- 
1995/'96. Because the surveys are held between 12 to 18 months after 
graduation, the study observes graduates at the beginning of their 
professional careers. In total, 133 graduates of BI and 99 graduates of IE 
responded to these surveys. 

Table 1 shows the distribution of these 232 respondents over a number of 
characteristics relevant for this paper. As can be seen, BI graduates 
significantly more often completed a tertiary-level education prior to their 
studies and more often have committee experience than IE graduates. 
Furthermore, BI graduates are employed significantly more often in large 
organizations than IE graduates. With respect to personal characteristics, it 
can be observed that IE has a significantly greater share of male graduates 
than BI. 
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Table 1. Characteristics of respondents 





IE 


IB 


Total 




Personal characteristics: 


sex: male* 


91% 


80% 


85% 




average age in years 


26.5 


26.4 


26.5 


(2.9)* 


Additional qualifications before graduation: 


previous tertiary education* 


0% 


13% 


7% 




earlier relevant work experience 


49% 


51% 


50% 




internship experience 


83% 


84% 


84% 




committee experience* 


35% 


54% 


46% 




Additional qualifications after graduation: 


participation in training 


66% 


74% 


71% 




average number of months in current job 


13.6 


14.8 


14.3 


(15.3)* 


Work characteristics: 


job at university level 


30% 


40% 


36% 




supervisory position 


22% 


23% 


23% 




average gross hourly wage (Dfl) 


24.5 


24.4 


24.5 


(6.2)* 


private sector 


95% 


93% 


94% 




large organization (>= 100 workers)* 


70% 


83% 


78% 





* Difference between tracks is significant at 5% level 

* Standard deviation 



4. CHARACTERIZATION OF THE LABOUR 

MARKET 

This section characterizes the labor market of BI studies and IE studies 
by occupation, industrial group, firm size, economic sector and required 
knowledge and skills, respectively. 

4.1 Occupation and Industrial Group 

The next two tables characterize the labor market by occupation (Table 
2) and industrial group (Table 3). The occupations and industrial groups are 
mentioned only if at least 5% of all paid working BI graduates or IE 
graduates work in them. 

Table 2 shows a great degree of overlap in occupations between the two 
groups of graduates. Only the ranking of their occupations differs. As can be 
seen, BI graduates work relatively slightly more often as advisors in the 
fields of automation/information, whereas IE graduates work slightly more 
often as systems analysts/designers. 
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Table 2. Characterization of the labor market by occupation 

Occupations* * of BI graduates: 

administrative automation advisors/information analysts 1 8% 

administrative automation and information project advisors 9% 

technical automation advisors/information analysts 7% 

assistant accountants 6% 

programmers (scientific applications, technical) 5% 

administrative system analysts/designers 5% 

organizational experts 5% 

Occupations* of IE graduates: 

- administrative system analysts/designers 1 1% 

technical system analysts/designers 10% 

technical automation advisors/information analysts 8% 

administrative automation advisors/information analysts 8% 

systems programmers (scientific applications, administrative) 6% 

systems/network managers 6% 

programmers (scientific applications, technical) 5% 

administrative automation and information project advisor 5% 

* Share at least 5% 



Not only with respect to occupations, but also with respect to industrial 
groups, there is a high degree of overlap between the two groups of 
graduates (Table 3). Nevertheless, BI graduates work slightly more often in 
accountant firms (7% versus 1%), while IE graduates work in systems 
design/systems analysis/programming services (8% versus 3%). 

Table 3. Characterization of the labor market by industrial group 



Industrial groups* of BI graduates: 

automation companies 34% 

computer service/IT firms 9% 

management consultancies 8% 

accountants 7% 

banking 6% 

Industrial groups* of IE graduates: 

automation companies 30% 

computer service/IT firms 13% 

- systems design/systems analysis/program services 8% 

management consultancies 6% 

banking 6% 

* Share at least 5% 
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4.2 Firm Size and Economic Sector 

The labor market of BI graduates and IE graduates is characterized in 
Table 4 by firm size and economic sector. The results show that while most 
BI and IE graduates work in large organizations, informatics engineers more 
often than BI graduates find employment in small and medium-sized 
organizations. We can also see that almost all BI and IE graduates work in 
private organizations. 



Table 4. Characterization of the labor market by firm size and economic sector 





BI 


IE 


Firm size: 


1 -9 workers 


3% 


7% 


10-99 workers 


14% 


22% 


3 100 workers 


83% 


70% 


Economic sector: 


private sector 


93% 


95% 


public sector 


7% 


5% 



4.3 Required Knowledge and Skills 

Although the occupational domains appear to overlap a great deal, there 
may be a difference between the qualifications expected from graduates 
from one type of study and from the other. We shall look at this in greater 
detail. On the basis of literature on job analysis (Algera, 1991) we compiled 
a list of 25 ‘qualification items’ that may be used to indicate demands for 
knowledge, general skills and personal skills. These three clusters of 
knowledge and skills, and the qualification items which compose them, are 
shown in Table 5. The qualification items are formulated in such a way that 
they can apply to people working in a variety of different fields. The 
graduates could indicate under each item how important they thought that 
particular qualification item was for them to perform well in their current 
paid activities. The response categories ranged from 1 to 5, corresponding to 
the responses ‘very unimportant’, ‘unimportant’, ‘neither important nor 
unimportant’, ‘important’, and ‘very important’, respectively. Table 5 shows 
the importance of the different kinds of knowledge and skills for both BI and 
IE graduates. The table contains for each qualification item the percentage 
share of graduates who stated that the knowledge or ski ll involved is (very) 
important for them to perform well in their current paid activities. 
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Table 5. The importance of knowledge and skills for BI and IE graduates 

BI IE 



Knowledge: 



- 


specialized professional knowledge 


78% 


81% 


- 


subject-specific methods and techniques 


72% 


72% 


- 


keeping up with recent developments in the field 


85% 


80% 


■ 


understanding of information & communication 
technology (incl. computer use): ICT 


91% 


83% 


“ 


understanding of legal regulations relevant to the 
profession* 


26% 


12% 




understanding of operational management 
(organizational, financial, administrative): BA ** 


76% 


49% 


General skills: 








application of (theoretical) knowledge and techniques in 
practice * 


79% 


66% 


- 


analytical and diagnostic (research) skills 


71% 


71% 


- 


quantitative (research) skills 


39% 


36% 


“ 


gathering and documenting information, data 
management 


60% 


59% 


- 


linguistic skills (command of foreign languages) 


51% 


53% 


- 


verbal presentation, fluency ** 


91% 


72% 


- 


written presentation, writing skills* 


84% 


73% 


- 


negotiating and commercial skills 


68% 


60% 


- 


planning, co-ordination and organization of activities* 


88% 


75% 


- 


leadership skills 


48% 


37% 


* 


teaching and training skills (incl. giving directions, 
knowledge transfer) 


51% 


43% 




making and maintaining contacts with other people 


88% 


78% 


Personal skills: 






- 


capacity for independent work* 


95% 


86% 


- 


initiative, creativity 


91% 


92% 


- 


ability to cope with stress** 


94% 


81% 


- 


accuracy, precision 


83% 


82% 


- 


adaptability* 


88% 


77% 


- 


loyalty, integrity, dealing with conflicts of interests** 


87% 


70% 


" 


systematic evaluation of results, establishing and using 
feedback 


77% 


71% 



* Difference is significant at 5% level. 
** Difference is significant at 1% level. 
Significant differences are shown bold 



The most important occupational requirements of BI graduates and IE 
graduates are specialized professional knowledge, keeping up with recent 
developments in the field, knowledge of ICT, planning skills, social skills, 
capacity for independent work, initiative/creativity, ability to cope with 
stress, accuracy/precision and adaptability (Table 5). At least 75% of both BI 
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graduates and IE graduates mentioned that these knowledge and s ki lls are 
(very) important for their daily work. Least important for the work of BI 
graduates and IE graduates are an understanding of legal regulations relevant 
to the profession, quantitative (research) s kil ls and leadership skills. Less 
than 50% of both BI graduates and IE graduates mentioned that these 
knowledge and skills are (very) important for good performance of their 
current paid work. 

When looking at the job requirements we find that certain knowledge 
(understanding managerial matters and relevant legal regulations), certain 
general skills (practical application of knowledge, planning skills and verbal 
& writing skills) and certain personal ski ll s (capacity for independent work, 
ability to cope with stress, adaptability and ability to deal with conflicts of 
interests) are significantly more important in jobs of BI graduates than in 
jobs of IE graduates. It is striking that none of the 25 knowledge items and 
skills proves to be more important in jobs of IE graduates than in jobs of BI 
graduates. This indicates that BI graduates, in spite of the fact that the 
occupational domain overlaps a great deal with that of IE graduates, have to 
meet higher job requirements. In this respect, the study of BI appears to play 
a complementary role to the study of IE in the labor market. 

4.4 The Graduates’ Field of Study and the Required 
Knowledge of ICT and Business Administration 

Both IE graduates and BI graduates are specialists in the field of ICT. BI 
graduates, however, have the additional advantage that they are also 
specialists in the field of business administration (BA). IE graduates will 
probably have more knowledge of ICT. It may be expected that graduates 
choose those jobs that best meet their field of expertise. By means of linear 
regression analysis, we have tried to estimate whether graduates choose 
those jobs that best match their field of study. This is to say that BI graduates 
more often choose jobs in which a great deal of knowledge of BA is 
required, while IE graduates more often choose jobs in which a great deal of 
knowledge of ICT is required. In the questionnaire, knowledge of BA is 
defined as an ‘understanding of operational management (organizational, 
financial, administrative), and knowledge of ICT as an ‘understanding of 
information & communication technology (including use of computers)’. 
The dependent variables in the estimates are the importance of knowledge of 
ICT and BA in thejob. As mentioned above, these variables were coded on a 
5-point scale, ranging from ‘very unimportant’ to ‘very important’. 

In these estimates, the probability of getting a job in which a great deal of 
knowledge of ICT or of BA is required, is explained by personal 
characteristics, the graduates’ knowledge of ICT and BA as indicated by 



Informatics in the let Society 



95 



their field of study, and by their additional qualifications acquired before 
graduating. The personal characteristics incorporated in the equation are 
‘sex: male’ and ‘age’. These act as control variables, whose expected sign is 
not clear. 

As mentioned above, the most important factor that may determine the 
probability of getting work requiring a great deal of knowledge of ICT or 
BA, is the graduates’ field of study. Since IE is chosen as the reference 
category in the equations, a positive sign may be expected with respect to 
choosing jobs in which much knowledge of BA is required and a negative 
sign with respect to jobs which require much knowledge of ICT. Apart from 
their field of study, graduates may have obtained additional knowledge of 
ICT and BA from previous education (especially if they had already 
completed a matching tertiary-level education), from experience on a 
management committee (for instance a student association), from work 
experience relevant to their field of study or from gaining internship 
experience. These factors were included in the analysis as the variables 
‘previous tertiary education’, ‘committee experience’, ‘relevant work 
experience’ and ‘internship experience’ . Committee experience and relevant 
work experience could be acquired either before or during their studies; 
internship experience only during their studies. Appendix 1 provides an 
overview of all variables. All variables used in this equation are recorded as 
dummy variables, except for the age in years. 

The results of the regression analyses in Table 6 show that the graduates 
from the field of study that generates most knowledge of BA, namely BI, 
indeed most often get jobs in which much knowledge of BA is required. This 
indicates that the BI study is complementary to the IE study when it comes 
to required knowledge of BA. 

Furthermore, no significant effect is found with respect to the field of 
study when it comes to getting jobs in which knowledge of ICT is important. 
This confirms our basic assumption that both fields of study educate 
specialists in the field of ICT, and hence are potential substitutes with 
respect to this kind of knowledge. 

The finding that committee experience significantly increases the chance 
of getting TTC-intensive jobs but does not increase the chance of an BA- 
intensive job is surprising, since committee experience does not generate 
special skills in the field of ICT. It is also surprising to find that relevant 
work experience significantly reduces the chance of finding TTC-intensive 
work, since this work experience is expected to increase the knowledge of 
ITC of both groups of graduates. 
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Table 6. Linear regression analysis of the importance of knowledge of ICT respectively BA in 
the job 





Importance of ICT 


Importance of BA 




Coefficient 


t-value 


Coefficient 


t-value 


Personal characteristics 
sex: male 


0.12 


0.78 


-0.02 


-0.09 


age 


-0.04 


-1.82 


-0.01 


-0.30 


Additional qualifications 
previous tertiary 


-0.40 


-1.75 


0.00 


0.01 


education 










- committee experience 


0.30* 


2.53 


0.13 


0.92 


relevant work experience 


-0.23* 


-2.03 


0.17 


1.24 


internship experience 


-0.03 


-0.20 


0.05 


0.27 


Qualifications 
BI study 


0.19 


1.60 


0.65** 


4.51 


Constant 


5.22* 


8.65 


3.40** 


4.79 


R-squared 




0.08 




0.12 


S.E. 




0.83 




0.97 


F 




2.73** 




4.18** 


N cases 




218 




215 



* Significant at the 5% level 
** Significant at the 5% level 



5. DEFICIENCIES IN REQUIRED KNOWLEDGE 
AND SKILLS 

This section examines the deficiencies in knowledge and skills 
experienced by BI and IE graduates. Table 7 shows for each qualification 
item the percentage share of paid working graduates who indicated that their 
studies should have paid more attention to this qualification item. As can be 
seen, both BI graduates and IE graduates often experienced deficiencies in 
the fields of keeping up with recent developments, verbal & writing skills, 
and negotiating & commercial skills. More than 50% of both BI graduates 
and IE graduates stated that their studies should have paid more attention to 
these skills. Both groups seldom experienced deficiencies with respect to 
their specialized professional knowledge, understanding of relevant legal 
regulations, quantitative (research) skills, capacity for independent work, 
accuracy/precision, and adaptability. Less than 25% of both BI graduates 
and IE graduates stated that the study they had completed should have paid 
more attention to these knowledge items and s ki lls. 
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Table 7. Attention needed for knowledge and skills (% more attention needed). 







BI 


IE 


Knowledge: 






- 


specialized professional knowledge 


23% 


16% 


- 


subject-specific methods and techniques 


29% 


30% 


- 


keeping up with recent developments in the field 


62% 


63% 


" 


understanding of information & communication 
technology (incl. computer use): ICT** 


38% 


19% 




understanding of legal regulations relevant to the 
profession* 


12% 


23% 


understanding of operational management 
(organizational, financial, administrative): BA ** 

General skills: 


25% 


53% 




application of (theoretical) knowledge and techniques in 
practice ** 


52% 


34% 


- 


analytical and diagnostic (research) skills 


32% 


23% 


- 


quantitative (research) skills 


9% 


5% 




gathering and documenting information, data 
management* 


18% 


31% 


- 


linguistic skills (command of foreign languages) 


34% 


35% 


- 


verbal presentation, fluency 


73% 


68% 


- 


written presentation, writing skills 


56% 


60% 


- 


negotiating and commercial skills 


58% 


62% 


- 


planning, co-ordination and organization of activities 


48% 


57% 


- 


leadership skills 


34% 


41% 


■ 


teaching and training skills (incl. giving directions, 
knowledge transfer) 


36% 


38% 


making and maintaining contacts with other people 
Personal skills: 


48% 


53% 


- 


capacity for independent work 


16% 


19% 


- 


initiative, creativity 


32% 


33% 


- 


ability to cope with stress* 


26% 


14% 


- 


accuracy, precision 


20% 


16% 


- 


adaptability 


19% 


21% 


- 


loyalty, integrity, dealing with conflicts of interests** 


44% 


26% 


" 


systematic evaluation of results, establishing and using 
feedback 


32% 


31% 



* Difference is significant at 5% level. 
** Difference is significant at 1% level. 
Significant differences are shown bold 



Table 7 also shows that Business Information graduates more often 
experienced shortcomings than informatics engineers in their knowledge of 
ICT and their ability to apply knowledge in practice, and in their ability to 
deal with conflicts of interest and to handle stress. Informatics engineers 
more often experienced deficiencies than business information scientists in 



98 



Hans Heijke & Ger Ramaekers 



their institutional and organizational knowledge (knowledge of legal 
regulations and understanding of organizational, financial & ad mi nistrative 
matters) and their - skills in dealing with data. 

Diagram 1 confronts the experienced deficiencies in knowledge and 
skills with their importance for occupational practice. If at least 50% of the 
graduates states that a certain knowledge or skill item received too little 
attention, then we consider their studies as having failed with respect to that 
particular knowledge or skill. This is more serious when that knowledge or 
s ki ll item is (very) important for the occupational practice of at least 75% of 
the graduates. If, on the other hand, less than 50% of the graduates states that 
a certain knowledge or skill item received too little attention, then we 
consider their studies as having paid sufficient attention to that particular 
knowledge or skill. This is even better when that knowledge or skill item is 
(very) important for the occupational practice of at least 75% of the 
graduates. 

The results in Diagram 1 demonstrate that both studies show serious 
shortcomings regarding the topic of keeping up with recent developments in 
the field. The BI study also shows also serious shortcomings with respect to 
the practical application of knowledge and verbal & writing skills. The IE 
study also fails when it comes to verbal & writing skills. This is, however, 
less serious because these skills are less important for IE graduates. More 
serious is the fact that the IE study fails in stimulating planning skills and 
social s ki lls. 

Diagram 1 also shows that both studies score well with respect to certain 
important knowledge and skills, such as specialized professional knowledge, 
knowledge of ICT, capacity for independent work, initiative/creativity, the 
ability to cope with stress, accuracy/precision, and adaptability. The BI study 
also performs well in the fields of understanding managerial matters, 
planning skills, social skills, dealing with conflicts of interests, and 
systematic evaluation. 

If graduates think that a knowledge or skill item that is (very) important 
for good performance in current paid activities should be given more 
attention, they believe that their level of the required knowledge or skill item 
is insufficient. In this case, it is to be expected that they are more likely to 
participate in further training. In the next section, we will estimate the 
probability of graduates participating in training. 
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Diagram I. Comparison of acquired and required knowledge and skills 







BI graduates 


IE graduates 


Serious deficiencies 1): 






• 


keeping up with recent developments in the field 


X 


X 


• 


application of (theoretical) knowledge and techniques in 


X 




• 


practice 
verbal skills 


X 




• 

• 


writing skills 
planning skills 


X 


X 


• 


social skills 




X 


Less serious deficiencies 2): 






• 


negotiating and commercial skills 


X 


X 


• 


understanding of operational management 




X 


• 


verbal skills 




X 


• 


writing skills 




X 


Sufficient, but less relevant knowledge and skills 3): 






• 


subject-specific methods and techniques 


X 


X 


• 


understanding of legal regulations relevant to the 
profession 


X 


X 


• 


application of (theoretical) knowledge and techniques in 
practice 




X 


• 


analytical and diagnostic (research) skills 


X 


X 


• 


quantitative (research) skills 


X 


X 


• 


gathering and documenting information, data 


X 


X 


• 


management 

linguistic skills (command of foreign languages) 


X 


X 


• 


leadership skills 


X 


X 


• 


teaching and training skills 


X 


X 


• 


loyalty, integrity, dealing with conflicts of interests 




X 


• 


systematic evaluation of results, establishing and using 
feedback 




X 


Sufficient, relevant knowledge and skills 4): 






• 


specialized professional knowledge 


X 


X 


• 


understanding of ICT 


X 


X 


• 


understanding of operational management 


X 




• 


planning skills 


X 




• 


social skills 


X 




• 


capacity for independent work 


X 


X 


• 


initiative, creativity 


X 


X 


• 


ability to cope with stress 


X 


X 


• 


accuracy, precision 


X 


X 


• 


adaptability 


X 


X 


• 


loyalty, integrity, dealing with conflicts of interests 


X 




• 


systematic evaluation of results, establishing and using 
feedback 


X 





1) % (very) important >=75 and % more attention needed =>50 

2) % (very) important <75 and % more attention needed =>50 

3) % (very) important <75 and % more attention needed <50 

4) % (very) important >=75 and % more attention needed <50 
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6. PARTICIPATION IN TRAINING 

Deficiencies with respect to the required knowledge and ski ll s can be 
dealt with in two ways. One way is to prevent them from occurring by giving 
the knowledge and skills concerned more attention in initial education. 
Another way is to reduce these deficiencies in knowledge and skills by 
means of participation in training after graduation. In the questionnaire, the 
graduates were asked if they had taken any training course or company 
training after leaving university and, if so, to list the most important subjects 
of this training course or company training (if they had taken more than one 
training course or company training after leaving university, they were asked 
to list the most important subjects of the most recent training course or 
company training). Most BI graduates (74%) and IE graduates (66%) had 
participated in training (courses and company training) after leaving 
university. Table 8 shows that most training was in the field of ICT, 
followed by business administration and communicative skills. On balance, 
47% of IE graduates and 29% of BI graduates participated in training in the 
field of ICT, 1% of IE graduates and 10% of BI graduates in the field of 
business administration, and 4% of IE graduates and 6% ofBI graduates in 
the field of communication skills. 



Table 8. Fields of Training 





BI 


IE 


Total 


ICT 


43% 


72% 


55% 


Business Administration 


14% 


2% 


9% 


Communicative Skills 


9% 


6% 


8% 


Banking 


8% 


2% 


5% 


Other fields of training 


26% 


18% 


23% 



* Share < 5% 



This section estimates the graduates’ chances of having participated in 
training in the field of ICT and the field of BA after graduation. In these 
logistic regression equations, the probability of participating in training is 
explained by personal characteristics, the graduates’ formal qualifications (as 
indicated by their previous education and their current field of education) 
and their informal, additional qualifications acquired before graduating. In 
our analysis this chance also depends on the knowledge of ICT or BA that 
the individual graduates acquired during their studies, the required 
knowledge of ICT/BA in the job, the length of time that the graduates have 
worked in their current jobs, and the organization in which they worked. It 
may be expected that graduates are more likely to participate in training in 
the field of ICT/BA if they have acquired insufficient knowledge of ICT/BA 
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during their studies, if a great deal of such knowledge is required in the job, 
and if their firm offers ample training facilities. 

The knowledge of ICT or BA that the individual graduates had acquired 
during their studies is first indicated by the field of study in which they 
graduated. It may be expected that IE probably generates more knowledge of 
ICT than BI, while BI probably generates more knowledge of BA. Since IE 
acts as the reference category in the equation, a positive sign may be 
expected with respect to participation in ICT training and a negative sign 
with respect to participation in training in the field of business 
administration. 

Before or during their studies, graduates may have obtained extra 
knowledge of ICT and BA from previous education, from experience on a 
management committee, from work experience relevant to their studies, or 
from internship experience. It may be clear that if a certain knowledge or 
skill item should be given less or the same amount of attention, the graduates 
thought that they had acquired the required knowledge or skill item at a 
sufficient level. On the other hand, if a certain knowledge or skill item (in 
this case knowledge of ICT or BA) should be given more attention according 
to the graduates (the variables ‘ICT needs more attention’ and ‘BA needs 
more attention’), they thought that their knowledge of ICT or BA was 
insufficient and hence they were more likely to participate in ICT or BA 
training. The chance of having participated in training will also increase the 
longer the graduate has worked in the presentjob. 

It may be assumed that graduates who work in large organizations are 
more likely to participate in training because large organizations can offer 
more training facilities than small organizations. Due to competition, private 
organizations have a greater urge to implement new ICT and to give BA 
much thought than public organizations and hence a greater urge to 
implement training activities in these fields. 

The graduates’ chance to participate in ICT or BA training is explained 
by two personal characteristics (‘age ‘ and ‘sex: male’). It may be expected 
that the incentive to participate in training decreases with age. T hi s is due to 
the fact that the time span in which returns to the investment in training can 
be earned back decreases with age (see for instance Mincer, 1974). 
Considering the expected possible loss of human capital when interrupting 
or even ending working life for raising children, 'sex: male' is expected to 
have a positive effect on the participation in training (see for instance Green, 
1993; Shackleton, 1995). Appendix 1 provides an overview of all variables. 
All variables used in this equation are recorded as dummy variables, except 
for the age in years and the number of months in the current job. The results 
of the regression analysis are shown in Table 9. 
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Table 9. Logistic regression analysis of the graduates (chance of participating in training) 





ICT training 
Coefficient 


S.E. 


BA training 
Coefficient 


S.E. 


Personal Characteristics 










Sex: male 


.98* 


.48 


1.86 


.69 


Age 


.05 


.06 


1.00 


.11 


Additional qualifications before graduation 








Previous tertiary education 


!.40 


.64 


1.30 


1.20 


Committee experience 


1.46 


.32 


.28 


.65 


Relevant work experience 


!.09 


.31 


1.09 


.64 


Internship experience 


.06 


.43 


1.62 


.83 


Acquired and required qualifications 








BI study 


!.30 


.33 


2.24* 


1.13 


ICT needs more attention 


1.22 


.35 






ICT is important 


.03 


.46 






BA needs more attention 


.19 


.72 






BA is important 


.13 


.77 






Number of months in job 


.01 


.01 


1.01 


.03 


Work organization 










Private sector 


1.54 


.86 


10.80 


1.09 


Large organization 


.82* 


.39 


.85 


1.09 


Constant 


15.30* 


2.08 


14.17 


4.08 


2 Log Likelihood 


281.0 




97.3 




Likelihood Ratio 


19.0 




14.8 




N cases 


210 




208 





* Significant at the 5% level 



6.1 Participation in ICT Training 

The results in Table 9 show that the chance of participating in training in 
the field of ICT depends on the graduate’s sex and the size of the 
organization in which he/she works. As was expected, men are more likely 
to participate in training (but only in the field of ICT) than women. As was 
also expected, graduates are more likely to participate in training (but again 
only in the field of ICT) if they work in large organizations. Surprisingly, 
participation in ICT training does not depend on the importance of ICT in 
the job, nor on the knowledge of ICT which the individual graduates have 
acquired during their studies. It seems that BI and IE graduates do not take 
ICT training because they feel that they have acquired insufficient 
knowledge of ICT during their studies and hence because they want to 
reduce deficiencies in their knowledge of ICT. It may be that BI and IE 
graduates, who are specialists in the field of ICT, participate in ICT training 
because they want to professionalize further in their field of expertise or 
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because when they entered the firm, they were confronted with firm-specific 
requirements with respect to ICT that were not reflected in the more general 
questions regarding the importance of ICT knowledge and s kil ls in the 
current jobs. 

6.2 Participation in BA Training 

The results of the regression analysis displayed in Table 9 show that the 
only variable that has a significant effect on the chance of participating in 
training in the field of BA, is the graduate’s field of study. As can be seen, 
BI graduates participate more often in BA training than IE graduates. In this 
respect, it should be borne in mind that knowledge of BA is to a larger extent 
required in the jobs of BI graduates than in the jobs of IE graduates (see 
Table 5). The fact that the graduates do not feel that they have acquired 
insufficient knowledge of BA during their studies (no significant effect of 
the variable ‘BA needs more attention’), indicates that BI graduates do not 
participate in BA training in order to reduce deficiencies in their knowledge 
of BA. BI graduates, who are specialists in the field of BA, may participate 
in BA training because they want to professionalize further in their field of 
expertise or because when they entered the firm, they were confronted with 
firm-specific requirements with respect to BA that were not reflected in the 
more general questions regarding the importance of BA knowledge and 
skills in the currentjobs. 



7. WAGES 

This section examines whether deficiencies in the required knowledge of 
ICT and BA had a negative effect on the graduates’ economic value for their 
company as indicated by their wage level. For this purpose, we estimated a 
wage function, with the knowledge of ICT and BA required in the job and 
acquired in the study being incorporated as explanatory variables. 

In the wage function, the natural logarithm of the gross hourly wages is 
explained in a linear equation on the basis of personal characteristics, 
additional qualifications acquired before or after graduation, the graduates’ 
shortcomings with respect to knowledge of ICT and BA, the job 
requirements regarding knowledge of ICT and BA, and the level and 
supervisory nature of their job. By incorporating in the wage function not 
only the graduates’ level of acquired knowledge of ICT and BA but also the 
degree in which this knowledge is required in his job, we follow the 
economic theory that takes explicit account of whether the applicability of a 
person's knowledge and skills is context-specific, namely the job matching 
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theory (for an overview, see Sattinger, 1993). In this theory, it is assumed 
that the knowledge and ski ll s that individuals possess, do not give them any 
absolute advantages in employment, but rather that their productivity is 
partly determined by the characteristics of the specific function that they 
perform. By utilizing their knowledge and s kil ls where these will generate 
the highest productive output, they can achieve comparative advantages. The 
job matching theory differs in this respect from the human capital theory, 
which supposes that people's knowledge and ski ll s generate the same output 
wherever they are applied, so that it makes no difference how the labor 
supply is allocated between the available jobs (for a broad outline of the 
human capital theory, see Schultz, 1961). 

The personal characteristics that have been incorporated in the wage 
function are: 'sex: male', 'age' and 'age squared'. 'Sex: male' is expected to 
have a positive effect on wages, due to the possibility that employers expect 
a loss of human capital for women when they interrupt working life to raise 
children. 'Age' is also expected to have a positive effect, because one's work 
experience increases with age. 'Age squared' is expected to have a negative 
effect because productivity increase declines with age (see for instance 
Mincer, 1974). The expected effects of an individual's knowledge and s ki lls 
are also positive. 

The additional qualifications before graduation, which have been 
incorporated in the wage function, are expected to increase a graduate’s 
amount of human capital and hence productivity as indicated by the wages. 
The incorporated additional qualifications after graduation are: ‘participation 
in ICT training’, ‘participation in BA training’ and ‘number of months in 
job’. The last variable is expected to have a positive sign because the length 
of experience in the current job enhances the productivity of the graduate in 
this job. The variables ‘participation in ICT training’ and ‘participation in 
BA training’ may affect wages in two opposite ways. The effect of training 
on wages may be positive through the mechanism of increased productivity 
(see for instance Becker, 1975). On the other hand, the mere fact of 
participating in training implies direct costs, which the employer may shift 
on to the worker in the form of lower wages. 

The variables ‘ICT needs more attention’ and ‘BA needs more attention’ 
indicate a deficiency of knowledge in these fields and hence are expected to 
have a negative effect on productivity and therefore on wages. 

The job characteristics, incorporated in the wage equation, refer to a job 
for which the employer requires a university-level education (‘job at 
university level’), having supervision over other workers (‘supervisory 
position’) and the degree in which knowledge of ICT and BA is required in 
thejob (the variables ‘ICT is important’ and ‘BA is important’). The variable 
‘job at university level’ is expected to have a positive effect on wages 
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because the level of the job matches the graduate’s educational level. The 
job requirements with respect to knowledge of ICT and BA act as control 
variables whose expected signs are not a priori clear. 

All explanatory variables are recorded as dummy variables, except for 
the age in years and the number of months in the current job. Appendix 1 
provides an overview of all variables. 



Table 10. Linear regression analysis of the gross hourly wage (In) 





BI graduates 
Coefficient t-value 


IE graduates 
Coefficient t-value 


Personal characteristics 










Sex: male 


1.020 


1.52 


1.097 


11.04 


Age 


1.037 


1.58 


.062 


.61 


Age squared 


.000 


.93 


1.000 


1.37 


Additional qualifications before 










graduation 










Committee experience 


1.010 


1.31 


.065 


1.11 


Relevant work experience 


.052 


1.68 


1.079 


11.39 


Internship experience 


1.076 


11.64 


.167* 


2.40 


Additional qualifications after graduation 








Participation in ICT training 


.017 


.50 


.115 


1.87 


Participation in BA training 


.010 


.19 


1.251 


1.96 


Number of months in job 


.000 


.56 


.007 


1.84 


Acquired knowledge 










ICT needs more attention 


1.043 


11.34 


.006 


.08 


BA needs more attention 


.023 


.61 


10.020 


1.34 


Job characteristics 










ICT is important 


1.090 


11.70 


.199** 


2.96 


BA is important 


1.015 


10.40 


.013 


.23 


Job at university level 


.059 


1.73 


.167* 


2.46 


supervisory position 


.009 


.22 


.047 


.68 


Constant 


3.57** 


3.82 


1.577 


1.05 


R-squared 


.38 




.38 




S.E. 


.15 




.23 




F 


3.79** 




2.92** 




N cases 


108 




88 





* Significant at the 5% level 
** Significant at the 1% level 



The wage equations for BI graduates and IE graduates, respectively, were 
estimated using linear regression analysis. The results in Table 10 show that 
IE graduates who completed an internship during their studies earn higher 
wages, indicating that this particular form of experience enhances their 
human capital and hence productive value. The wages of IE graduates also 
increase as the required educational level for the job matches the university- 
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level education of the graduates, indicating that the university-level 
knowledge and skills which they possess can be put into use most 
productively in jobs in which university-level knowledge and s kil ls are 
required. Lastly, IE graduates earn higher wages in jobs that require much 
knowledge of ICT, indicating that their ICT knowledge can be used most 
productively in jobs in which this particular kind of knowledge is required. 

For both BI graduates and IE graduates, the wage level does not depend 
on the experienced deficiencies in knowledge of ICT or BA that individual 
graduates have acquired during their studies, nor on participation in training 
in these fields. The mere fact that employers do not shift on to the graduates 
the training costs in the form of lower wages, indicates that there are no 
deficiencies in generally applicable knowledge of ICT or BA. On the 
contrary, it seems that employers invest in ICT or BA training for these 
specialists because they want to invest in the further professionalization of 
their specialist workers with a view to their future role in the firm or because 
the ICT or BA training of these young specialists is aimed at removing any 
firm-specific deficiencies in these areas, meaning that their training is aimed 
at qualifications that only have productive value within the firm itself 
(Becker, 1975; Hashimoto, 1981). 



8. CONCLUSIONS 

In this paper we compared the labor market position of graduates from 
two fields of study that specialize in ICT, namely the technical study of 
informatics engineering and the economics study of business informatics. As 
far as knowledge of ICT is concerned, BI is directed mainly at the 
development of automated systems for managing, administrating and 
running organizations, whereas IE also focuses on the development of 
embedded software and techniques for industrial automation and industrial 
process operation. Both fields of study educate specialists in the field of ICT. 
However, BI graduates probably acquire more knowledge of BA than IE 
graduates. IE graduates probably acquire more knowledge of ICT. 

We found that the occupational domains of the two groups of graduates 
show a great degree of overlap, indicating substitution on the labor market. 
However, certain knowledge and skills (e.g. understanding managerial 
matters, planning skills, verbal & writing skills, ability to cope with stress 
and to deal with conflicts of interests), are more important in jobs of BI 
graduates than in jobs of IE graduates. None of the 25 knowledge items and 
skills proves to be more important in jobs of IE graduates than in jobs of BI 
graduates. This indicates that BI graduates have to meet higher job 
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requirements and that the BI study is, at least in these aspects, 
complementary to the IE study. 

By means of linear regression analysis, we estimated whether graduates 
choose those jobs which best match their field of study. We found that the 
graduates from BI, the field of study which generates most knowledge of 
BA, indeed most often have jobs that require much knowledge of BA. This 
indicates that the BI study is complementary to the IE study when it comes 
to required knowledge of BA. When it comes to finding a job in which 
knowledge of ICT is important, no significant effect of the field of study was 
found, indicating that both fields of study educate specialists in the field of 
ICT, and hence are substitutes with respect to this kind of knowledge. 

With respect to knowledge of ICT and BA, business information 
scientists state more often than informatics engineers that their studies 
should have paid more attention to knowledge of ICT. Informatics engineers 
indicate more often than business information scientists that their studies 
should have paid more attention to knowledge of BA. 

The majority of both BI and IE graduates take part in training courses or 
company training after leaving university. Most training is in the field of 
ICT, followed by BA and communicative skills. We found that participation 
in ICT training does not depend on the importance of knowledge of ICT in 
the job nor on the knowledge of ICT that individual graduates have acquired 
during their studies. It seems that BI and IE graduates, all of whom are 
specialists in the field of ICT, do not take ICT training to reduce deficiencies 
in their knowledge of ICT. With respect to BA training, we found that BI 
graduates more often take training in this field than IE graduates. It seems 
that BI graduates (who are specialists in the field of BA) do not participate in 
BA training to reduce deficiencies in their knowledge of BA. 

We also found that the wages of these graduates are not significantly 
affected by their experienced deficiencies with respect to the available 
knowledge of ICT or BA nor by their later participation in training in these 
fields. It is possible that these specialists do not take ICT or BA training in 
order to reduce deficiencies in required knowledge, but because their 
employers want to invest in their further professionalization with a view to 
their future functioning within the firm. Another explanation could be that 
the ICT or BA training of these specialists is aimed at removing certain firm- 
specific deficiencies in these areas, which manifest themselves when 
graduates enter the firm concerned. In both cases, there is no incentive for 
the employer to shift the training costs on to the workers in the form of lower 
wages. In this respect, the training of these specialists differs from the ICT 
training of economists in general. In an earlier study (Heijke & Ramaekers, 
1997), which included graduates from all economics disciplines, we found 
that employers shift on to economics graduates the costs involved with ICT 
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training in the form of lower wages. This points at training as a way of 
reducing deficiencies in basic, general applicable knowledge of ICT. 
Another indication for this was our finding in this study that economics 
graduates who stated that economics studies should pay more attention to 
ICT more often took ICT training than economics graduates who indicated 
that their studies had paid sufficient attention to ICT. 

With respect to the subject contents of the economic studies, the previous 
study therefore argued that more attention should be paid to generating ICT 
knowledge and s ki lls in the programs themselves. The present study shows 
that this does not apply to the economic study programs that specialize in 
ICT. In the field of ICT knowledge and skills, they experience slightly more 
deficiencies than the technical studies that specialize in ICT, but employers 
do not regard this as such a shortcoming of the study that this requires more 
training in this area, the costs of which would then be shifted on to the 
graduates. Although the occupational domains of the technical and economic 
ICT studies overlap to a great extent, it seems that graduates of the economic 
ICT studies must meet higher demands with regard to knowledge and skills. 
This concerns in particular knowledge and skills in the field of business 
administration. They therefore have a greater chance of ending up in jobs 
that require such skills, but without having a smaller chance of a job in 
which it is the ICT skills that are important. Although the graduates 
themselves indicate that more attention should have been paid to ICT 
knowledge and skills in their programs, they have no greater chance of 
receiving training in this area and, in spite of the experienced deficiencies in 
their studies, their employers do not pay them less, not even if this 
knowledge and these s kil ls are important for their proper functioning in their 
jobs. They do, however, have a greater chance of taking part in further 
training in the field of business administration, but presumably more as an 
investment in the future or to obtain firm-specific knowledge than as a 
means of removing any deficiencies resulting from their studies. With regard 
to the technical ICT studies, we may carefully draw the conclusion that, in 
order to widen their scope in the labor market, they could pay more attention 
to knowledge and skills in the field of business administration during their 
studies. 
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1. INTRODUCTION 

The purpose of this paper is to explain and demonstrate an innovative, 
action-learning, on li ne approach for teaching investments. 

Appropriate investment analysis, portfolio selection and management 
depend upon an understanding of basic financial concepts, information and 
good judgment. Until recently, one of the greatest constraints to effective 
investment management, at least for the average investor, was accessibility 
to information. The Internet, or online computing, of the 1990’s has 
dramatically alleviated that limitation. The shared computing of the 1970’s 
with expensive terminals, slow communications and user-unfriendly 
software made it difficult to share information between systems. In the 
1980’ s the inexpensive micro-processor-based PC brought computing power 
and local area networks to the people. While these networks helped users 
reach beyond their workstations, that reach extended only to other users and 
researchers within their organizations. Today, the ever-expanding electronic 
phenomenon known as the Internet (NET), which connects millions of 
computers around the world, is eliminating the technical and geographical 

til 
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obstacles that have been restraining the Information Revolution. The Net 
provides easy, almost instant access to: 

1 . up-to-the-minute financial news, 

2. mountains of information on the U.S. and other economies, financial and 
real asset markets of the world, 

3. detailed information on individual industries, companies, securities, 
mutual funds and real assets, 

4. financial forecasts, 

5. technical analysis, 

6. financial education, 

7. financial discussion groups, 

8. financial software and online calculators, 

9. online brokerage and other financial services, 

10. a market for some initial public offerings (IPO’s) and 

11. a virtual finance library including financial newspapers, periodicals, 
journals and research working papers. 

This information is accessible at lightning speeds and with desktop 
convenience. With the impending development of still higher speed 
telephone and cable modems, accessing web sites is expected to become as 
easy as changing channels on your television. 

The Internet has leveled the investment playing field between the 
individual and institutional investor. Coupled with the explosive expansion 
of the Net has been the development of today’s extremely powerful desktop 
computers and ever more sophisticated, but increasingly user-friendly, 
software. 

During this same period, we have experienced rapid growth in mutual 
fund investing and an expanding securitization of real assets. Further, the 
decline of communism and the world-wide spread of capitalism has given 
way to enormous growth of global investment opportunities and an ever- 
increasing number of world investors and investment capital. The Net will 
not only alter the relationship between professional and individual investors, 
but will facilitate this global investment revolution and will, likely, impact 
the entire investment process itself. 

The financial and economic information richness and convenience of the 
NET opens significant possibilities for innovative approaches to teaching 
investments. This paper details one such approach in which a number of 
hands-on projects, which directly involve the use of the NET, are the 
principal learning vehicles. 

The suggested experiential learning projects include: 

1. a security portfolio selection and tracking exercise; 
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2. a top-down investment analysis assignment involving an investment 
valuation and recommendation of the common stocks of from three to 
five publicly-traded corporations in a given industry; 

3. a comparative evaluation of the historical portfolio performance and 
future investment prospects of several mutual funds within a given 
mutual fund category, and 

4. a common stock screening project for selecting companies, from a vast 
universe of corporations, that meet specified investment criteria for 
possible inclusion in a portfolio. 

Suggested internet websites for obtaining the economic, financial market, 
sector and industry information, as well as company financial data, ratios, 
historical price graphs, technical charts, earnings and earnings growth 
forecasts, all necessary for implementing the above projects, are provided. 
Additionally, there is a generalized explanation of how to effectively 
integrate information and communication technology in this approach to 
teaching investments. 

Learning theory demonstrates that an individual’s understanding, recall 
and retention of new information is significantly enhanced when that 
information is presented in a comprehensive and meaningful manner. Recall 
from basic psychology, the experiment in which subjects are read 10 words 
and then, subsequently, asked to take one minute to write down all the words 
that they can recall from memory. The experiment is conducted in three sets. 
On the first pass, the subjects are read 10 nonsense syllables and asked to 
write down as many as they can recall. Because the words are unfamiliar, the 
recall rate is typically low. In the second set, the subjects are read 10 familiar 
words. The recall rate is much improved. On the third pass, the subjects are 
read 10 words in a complete sentence. Since the words are link ed in a 
comprehensive, meaningful way, the recall rate is significantly greater than 
in the first two sets. 

It is conjectured that greater comprehension and retention of investment 
definitions, concepts, theories and strategies occurs when teaching involves 
integrative, real-time, internet-based, experiential-learning projects. 
Traditional teaching of investment’s courses usually involves lectures on the 
various investment topics. Students are generally assigned readings and, 
additionally, exercises involving questions and problems at the end of the 
chapters. Subsequently, they are tested on their ability to identify definitions 
and concepts in a multiple choice exam, solve problems and/or write short 
essay answers to related questions. Typically, the topics are covered one at a 
time and, for the most part, in isolation. While teaching does progress from 
descriptive materials to higher level concepts and theories, simultaneous 
integration of all pertinent knowledge, skills, strategies and perspectives for 
making effective investment decisions is minimal or non-existent. Hence, it 
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is argued that the effectiveness of traditional teaching of investments can be 
significantly enhanced through the use of integrative, real-time, internet- 
based, experiential projects. It is hypothesized that the integrative, 
information technology approach described in this research stimulates, for 
students, greater interest, more intensive preparation efforts, greater 
comprehension of complex concepts and longer retention than occurs with 
traditional teaching. 

Based on my experience testing this approach on at least six 
undergraduate and MBA level investments classes in the past two years, it 
appears that these real world, internet-based, action-learning projects 
stimulate intense student interest and motivation because of the realism. 
Additionally, students comment that this approach to learning basic 
investment definitions, concepts and strategies is much more meaningful 
than traditional teaching methods, thus resulting in greater retention of the 
newly learned knowledge. Finally, the projects are quite simple to 
implement, requiring no special arrangements, case books, simulations, 
databases, diskettes or similar materials. However, this approach does 
require that students have access to a computer with internet capabilities, 
either through the educational institution or their personal equipment, and 
that they have basic knowledge for internet usage, or can receive 
introductory instruction on internet usage. 

Section II describes how to implement project (1) using the NET. 
Similarly, sections IE, IV and V explain, in detail, the use of the internet in 
correspondingly carrying out projects (2), (3) and (4). Section V provides the 
summary and overview of this approach to teaching investments. 



2. PORTFOLIO SELECTION AND TRACKING 
PROJECT 

The first project involves choosing and tracking one or more hypothetical 
portfolios. The choices may constitute exclusively, common stock, mutual 
funds, options (puts and calls) or bonds or a combination of some or all of 
these investments. 

At the instructor’s option, the students may simply buy and hold or be 
allowed to trade throughout the semester (or term) with gains (losses), 
holding period returns (FIPR’s) holding period yield’s (HPY’s) and 
annualized holding period yields being calculated and reported at the end of 
the investment period. The project should be assigned early in the course 
after some introductory instruction regarding the characteristics of the 
different types of investments and an explanation of how to read price quotes 
on the financial pages and on the internet. At this stage, the selection of the 
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investments may be based on intuition or involve only a minimal amount of 
research. Numerous internet websites provide price quotes and permit 
portfolio tracking. Some of these websites are: 



Information Provider 


Internet Address or URL 


First Call Estimates on Demand 


http://www.wsbi.com/firstcall/ 


Wall Street City 


http://www.wallstreetcity.com 


Data Broadcasting Corp. 


http://www.dbc.com 


Stock Point 


http://www.stockpoint.com 


America Online (AOL) 


AOL, (channel) Personal Finance, (selection) 
Portfolios (if AOL is your internet service 
provider) 


STOCK-TRAK ® 


htto://www.stocktrak.com 



Note: As of this writing, the first five listed websites provide portfolio selection and tracking 
as a free service. STOCK-TRAK ® does charge a fee per student(s) account but permits, and 
accounts for, frequent trading. A sample of the portfolio tracking web pages from First Call 
Estimates on Demand are provided in Tables 1, 2 and 3. 



3. TOP-DOWN INVESTMENT VALUATION 
PROJECT 

Consider an investment valuation project in which the student gets to 
choose an industry (e.g., computer software, Pharmaceuticals, beverage etc..) 
and from three to five companies within the industry to be comparatively 
evaluated for investment purposes. A comprehensive top-down investment 
evaluation entails: first , a global macro-economic and financial market 
analysis, second , a major sector and industry analysis and third , an analysis 
and evaluation of the investment prospects of the object companies. 

An analysis of the U.S. and global political macro-economic and 
financial market environment may entail, for example, (for the U.S) 
forecasting: real GDP growth, inflation, Consumer Price Index (CPI), 
interest rates (long-term - 30 year T-Bond rate and short-term - 30 day T- 
Bill rate), corporate profit growth rate, stock market price levels (DJIA or 
S&P 500), unemployment rate, currency exchange rates (yen/$, D.M./$) and 
other pertinent measures. For other countries or regions of the world the 
analysis may entail forecasting at least, real GDP growth, inflation (CPI) and 
other pertinent economic variables. 
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Table 1. Portfolio Manager Gain/Loss. 



Symbol 


Trade 

Date 


Trade 

Price 


#of 

Shares 


5:03 p.m. 
(ET) Price 


Gain/Loss 

$ 


% 


AOL 


10/20/96 


12.50 


200 


111.50 


19,800 


792.00 


BUD 


9/15/92 


36.00 


300 


50.63 


4,388 


40.60 


CSCO 


6/15/97 


37.50 


300 


100.19 


18,806 


167.20 


DELL 


12/28/93 


6.00 


400 


109.56 


41,425 


1726.00 


D1S 


8/22/95 


12.00 


500 


33.50 


10,750 


179.20 


GE 


6/09/95 


50.00 


50 


90.75 


2,038 


81.50 


GER 


2/10/93 


2.50 


500 


17.06 


7,281 


582.50 


GM 


2/10/93 


28.00 


200 


68.75 


8,150 


145.50 


MCD 


11/18/91 


12.50 


400 


65.75 


21,300 


426.00 


PZZA 


10/25/95 


12.00 


225 


30.00 


4,050 


150.00 










Total 


137,988 


276.00 


Reprinted from First Call Estimates on Demand Portfolio Page 






Table 2. Portfolio manager market value. 










Issue 


Amount % of Total Market Value 


% of Total 


Symbol 


Name 


Invested Invested ($) 




Value 


AOL 


America Online Inc. 


2,500 


5.00 


22,300 


11.9 


BUD 


Anheuser-Busch 


10,800 


21.60 


15,188 


8.1 




Companies 












CSCO 


Cisco Systems Inc. 


11,250 


22.50 


30,056 


16.0 


DELL 


Dell 

Corporation 


Computer 


2,400 


4.80 


43,825 


23.3 


DIS 


Walt 


Disney 


6,000 


12.00 


16,750 


8.9 




Company 












GE 


General 

Company 


Electric 


2,500 


5.00 


4,538 


2.4 


GER 


Germany Fund 


1,250 


2.50 


8,531 


4.5 


GM 


General 

Corporation 


Motors 


5,600 


11.20 


13,750 


7.3 


MCD 


McDonald's 




5,000 


10.00 


26,300 


14.0 




Corporation 












PZZA 


Papa John's Int'I, Inc. 


2,700 


5.40 


6,750 


3.6 






Total $ 50,000 


100.00 


187,988 


100 



Reprinted from First Call Estimates on Demand Portfolio Page 
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Table 3. Portfolio Manager Quotes. 



Symb 




Open 


High 


Low 


Last 


Net 


Volume 


Last 


ol 










Price 






Time 


AOL 


+ 


106.000 


111.500 


105.563 


111.500 


7.063 


6,593,900 


5:03pm 


BUD 


+ 


50.250 


50.625 


49.938 


50.625 


0.375 


1,273,900 


4:00pm 


CSC 

O 

DEL 


- 


98.750 


101.125 


98.500 


100.188 


2.063 


12,268,500 


4:01pm 


+ 


112.250 


114.125 


109.000 


109.563 


- 1.000 


23,962,400 


4:01pm 


D1S 


_ 


32.688 


33.625 


32.125 


33.500 


1.313 


5,796,500 


4:20pm 


GE 


- 


89.375 


91.313 


89.375 


90.750 


1.438 


4,291,300 


4:18pm 


GER 


- 


17.063 


17.063 


17.063 


17.063 


0.250 


30,100 


3:43pm 


GM 


+ 


67.875 


68.750 


67.063 


68.750 


0.750 


1,927,200 


4:09pm 


MCD 


- 


65.000 


66.125 


64.938 


65.750 


0.813 


1,535,000 


4:01pm 


PZZA 


+ 


29.500 


30.375 


29.063 


30.000 


0.625 


323,800 


4:00pm 



These 20-minute delayed quotes were generated 8/18/98 5:59:49 p.m. ET. 
Click the 'GO' button above to refresh the quotes. 

Reprinted from First Call Estimates on Demand Portfolio Page 



4. TOP-DOWN INVESTMENT VALUATION 
PROJECT 

Consider an investment valuation project in which the student gets to 
choose an industry (e.g., computer software, Pharmaceuticals, beverage etc..) 
and from three to five companies within the industry to be comparatively 
evaluated for investment purposes. A comprehensive top-down investment 
evaluation entails: first , a global macro-economic and financial market 
analysis, second , a major sector and industry analysis and third , an analysis 
and evaluation of the investment prospects of the object companies. 

An analysis of the U.S. and global political macro-economic and 
financial market environment may entail, for example, (for the U.S) 
forecasting: real GDP growth, inflation, Consumer Price Index (CPI), 
interest rates (long-term - 30 year T-Bond rate and short-term - 30 day T- 
Bill rate), corporate profit growth rate, stock market price levels (DJIA or 
S&P 500), unemployment rate, currency exchange rates (yen/$, D.M./$) and 
other pertinent measures. For other countries or regions of the world the 
analysis may entail forecasting at least, real GDP growth, inflation (CPI) and 
other pertinent economic variables. 
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While there are numerous websites which provide information to assist 
this U.S. and global macro-economic analysis, following are two sites which 
are particularly useful: 

Information Provider Internet Address or URL 

Dr. Ed Yardeni’s Economics Network http://www.yardeni.com 

The Economist Intelligence Unit on AOL AOL, Keyword: EIU 



Table 4, figure 1 and table 5 provide samples of the type of information 
available through these websites. 




Keyword: EIU 



flnfaF 



The Econo 



cover j(jt* 



Latest Country Alerts 



New from the EIU 






EmSsSIu 



August 10th 1998 

Holland goes online 

Japan's prospects 

Hungary and the Czech Republic to 

— 



D Japan Business outlook 
0 Czech Republic 1998-2001 



Figure 1. Reprinted from: The Economist Intelligence Unit on AOL. 
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Table 5. Asia, regional forecasts 





1997 


1998 


1999 


GDP (real % change ) 
Australasia 


2.8 


2.3 


2.7 


ASEAN 


4.6 


- 5.0 


0.7 


Greater China 


8.0 


5.8 


6.6 


South Asia 


4.2 


4.6 


5.4 


Japan and the NICs 


1.9 


- 0.0 


1.6 


Asia & Australasia, incl Japan 


3.1 


1.0 


2.7 


Asia & Australasia, excl Japan 


5.8 


2.8 


4.6 


Consumer price inflation (%) 
Australasia 


0.5 


1.6 


1.6 


ASEAN 


5.2 


25.6 


9.0 


Greater China 


2.8 


3.8 


5.0 


South Asia 


7.3 


9.4 


8.5 


Japan and the NICs 


2.0 


1.3 


1.5 


Asia & Australasia, incl Japan 


2.6 


4.0 


3.2 


Asia & Australasia, excl Japan 


3.8 


8.1 


5.8 


Current account balance (US$ bn) 
Australasia 


- 26.4 


- 27.9 


- 31.0 


ASEAN 


- 6.1 


11.9 


11.1 


Greater China 


26.4 


28.4 


21.2 


South Asia 


- 10.3 


- 8.1 


- 11.1 


Japan and the NICs 


101.7 


154.7 


167.0 


Asia & Australasia, incl Japan 


69.4 


147.9 


149.0 


Asia & Australasia, excl Japan 


- 25.1 


25.7 


9.0 


Merchandise trade balances (US$ bn) 
Australasia 


- 3.7 


- 3.8 


- 4.9 


ASEAN 


2.0 


20.6 


16.6 


Greater China 


42.4 


45.3 


39.3 


South Asia 


- 13.7 


- 11.1 


- 13.4 


Japan and the NICs 


91.8 


140.3 


148.4 


Asia & Australasia, incl Japan 


124.8 


196.8 


195.0 


Asia & Australasia, excl Japan 


23.2 


78.2 


67.0 


(a) Excluding Japan 









Reprinted from: The Economist Intelligence Uniton AOL. ASEAN: Association of Southeast 
Asian Nations; Indonesia, Malaysia, Philippines, Singapore. NICs: Newly industrializing 
countries; Hong Kong, Singapore, South Korea, Taiwan Greater China: China, Hong Kong, 
Taiwan. 



120 



Richard J. Curcio 



Table 4. Deutsche Banc Alex. Brown Economic Forecasts (reprinted from www.yardenic.com) 



Item (1) 


Q1A 


1999 

Q2A 


Q3A 


Q4A 


Q1E 


2000 

Q2E 


Q3E 


Q4E 


99/ 

98A 


00/ 

99 


Real GDP 


3.7 


1.9 


5.7 


5.8 


4.1 


3.2 


4.0 


4.5 


3.9 


4.3 


Final Sales 


4.6 


3.4 


4.5 


4.6 


4.9 


3.8 


4.0 


4.1 


4.3 


4.3 


Personal Consumption Exp. 


6.5 


5.1 


4.9 


5.3 


5.0 


3.7 


4.0 


4 


5.3 


4.6 


Durable Goods 


12.4 


9.1 


7.7 


11.8 


8.3 


2.8 


4.7 


4.2 


11.4 


7.1 


Nondurable Goods 


89 


3.3 


3.6 


6.1 


3.4 


2.2 


2.6 


2.4 


5.3 


3.5 


Services 


4.2 


5.2 


5.0 


3.5 


5.0 


4.6 


4.6 


4 8 


4.0 


4.6 


Nonresidential Fixed Investment 


7.8 


7.0 


10.9 


2.5 


13.0 


13.4 


14.5 


12.9 


8.3 


10.6 


Structures 


-5.8 


-5.3 


-3.8 


-5.3 


5.9 


1.6 


0 8 


0 


-2.7 


0.0 


Producer's Durable Equipment 


12.5 


11.2 


15.7 


4.9 


14.6 


16.2 


17.7 


15.7 


12.0 


13.5 


Residential Fixed Investment 


12.0 


5.5 


-3.8 


-1.2 


3.2 


1.1 


0.0 


1.1 


7.2 


0.7 


Inventory Invest. (Billion 92$) 


50.1 


14.0 


38.0 


65.4 


47.4 


33.4 


334 


41.4 


41.9 


389 


Net Exports (Billion 92$) 


-284 


-319 


-338 


-256 


-381 


-401 


-426 


-441 


-324 


-412 


Total Government Purchases 


5.1 


1.3 


4.5 


8.4 


4.4 


1.9 


2.0 


0.9 


3.7 


4.0 


Federal Government Purchases 


-0.5 


2.1 


4.1 


16.0 


3.6 


3.2 


2.8 


1.4 


2.9 


5.5 


State & Local Gov't Purchases 


8.3 


0.9 


4.8 


4.4 


4.9 


1.2 


1.6 


0.7 


4.1 


3.1 


Real GDP (2) 


3.7 


3.6 


4.0 


4.0 


4.2 


4.7 


4.3 


3.9 


4.0 


3.9 


Industrial Production (2) 


2.8 


3.2 


3.7 


4.5 


3.8 


3.5 


3.8 


3.7 


4.5 


3.7 


Car&Light Truck Sis Mill. Units 


15.5 


16.0 


16.4 


16.0 


16.4 


15.9 


15.7 


16.1 


16.0 


16.0 


Cars 


84 


8 8 


8.8 


8.8 


9.0 


8.7 


8.5 


8 8 


8.7 


88 


Domestic Models 


6.9 


7.1 


7.1 


6.8 


7.2 


7.0 


6.8 


7.1 


7.0 


7.0 


Imported Models 


1.5 


1.7 


1.7 


2.0 


18 


1.7 


1.7 


1.7 


1.7 


1.7 


Light Trucks 


7.1 


7.2 


7.6 


7.3 


7.4 


7.2 


7.2 


7.3 


7.3 


7.3 


Housing Starts (Million Units) 


1.8 


1.6 


1.7 


1.7 


1.7 


1.6 


1.7 


1.6 


1.7 


1.7 


Unemployment Rate (Percent) 


4.3 


4.3 


4.2 


4.1 


4.0 


4.0 


3.9 


3.9 


4.2 


4.0 


Consumer Price Index (3) 


1.5 


2.9 


4.2 


2.2 


1.5 


1.2 


1.0 


1 


2.7 


1.2 


Implicit Price Index, GDP 


1.9 


1.4 


1.0 


2.0 


1.2 


0.1 


0 8 


08 


1.4 


1.0 


Unit Labor Costs, Nonfarm Bus. 


1.5 


4.4 


-0.4 


1.2 


1.0 


2.0 


1.5 


l.l 


1.9 


1.3 


Hourly Comp., Nonfarm Bus. 


4.3 


4.6 


4.9 


4.4 


4.4 


4.5 


4.7 


4.7 


4 8 


4.6 


Productivity, Nonfarm Bus. 


2.5 


0.7 


5.1 


3.2 


3.4 


2.5 


3.2 


3.6 


2.8 


3.2 


Book Profits After Taxes (2) 


3.9 


5.5 


10.9 


14.7 


8.5 


10.6 


12.3 


1 1.9 


8.7 


10.8 


Real Disposable Personal Income 


0.3 


2.9 


3.1 


4.4 


6.8 


3.7 


3.6 


4 


3.0 


4.5 


Personal Savings Rate (Percent) 


3.0 


2.5 


2.1 


1.9 


2.3 


2.3 


2.2 


2.2 


2.4 


2.3 


Prime Rate (Percent) 


7.8 


7.8 


8.1 


8.4 


8.7 


9.0 


9.0 


9.0 


8.0 


8.9 


3-Month Treasury Bills (Percent) 


4.4 


4.4 


4.6 


5.0 


5.7 


6.0 


6.0 


6.0 


4.6 


5.9 


30- Year Governments (Percent) 


5.4 


5.8 


6.0 


6.3 


7.0 


6.7 


6.5 


6.2 


5.9 


6.6 


Trade-Weighted Dollar 


100.0 


102.0 


100.0 


101.0 


103.0 


105.0 


107.0 


107.0 


100.8 


105.5 



A = Actual. E = Estimate. (1) Quarterly and annual average percent change. Forecasts are 
rough estimates based on very limited information & are subject to frequent and large 
revisions as new information becomes available. (2) Four-quarter percent change. (3) Percent 
change based on last month of quarter or year. 



